-- Logs begin at Mon 2022-06-20 14:09:37 UTC, end at Mon 2022-06-20 15:12:20 UTC. -- Jun 20 14:43:40.805552 dv-cinder-836973-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 14:43:40.813018 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 14:43:40.815329 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 14:43:40 2022] *** Jun 20 14:43:40.815329 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 14:43:40.815329 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 14:43:40.815329 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: nodename: dv-cinder-836973-5-iscsi Jun 20 14:43:40.815329 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: machine: x86_64 Jun 20 14:43:40.815329 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: clock source: unix Jun 20 14:43:40.815329 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: pcre jit disabled Jun 20 14:43:40.815329 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: detected number of CPU cores: 4 Jun 20 14:43:40.815329 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: current working directory: / Jun 20 14:43:40.815329 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: detected binary path: /usr/bin/uwsgi-core Jun 20 14:43:40.815329 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: your processes number limit is 47680 Jun 20 14:43:40.815329 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: your memory page size is 4096 bytes Jun 20 14:43:40.815329 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: detected max file descriptor number: 2048 Jun 20 14:43:40.815329 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: lock engine: pthread robust mutexes Jun 20 14:43:40.816230 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: thunder lock: enabled Jun 20 14:43:40.816230 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 14:43:40.816230 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 14:43:40.859790 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: Python main interpreter initialized at 0x55e32d1ce9c0 Jun 20 14:43:40.859790 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: python threads support enabled Jun 20 14:43:40.859790 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: your server socket listen backlog is limited to 100 connections Jun 20 14:43:40.859790 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: your mercy for graceful operations on workers is 90 seconds Jun 20 14:43:40.860164 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 14:43:40.860227 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: *** Operational MODE: preforking *** Jun 20 14:43:40.860498 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: *** uWSGI is running in multiple interpreter mode *** Jun 20 14:43:40.860498 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: spawned uWSGI master process (pid: 109598) Jun 20 14:43:40.860765 dv-cinder-836973-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 14:43:40.863238 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: spawned uWSGI worker 1 (pid: 109599, cores: 1) Jun 20 14:43:40.863238 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: spawned uWSGI worker 2 (pid: 109600, cores: 1) Jun 20 14:43:40.863238 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 14:43:41.509408 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 14:43:41.530021 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 14:43:42.648334 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 14:43:42.648334 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: from cryptography.utils import int_from_bytes Jun 20 14:43:42.649021 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 14:43:42.649021 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: from cryptography.utils import int_from_bytes Jun 20 14:43:42.679705 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 14:43:42.679705 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: from cryptography.utils import int_from_bytes Jun 20 14:43:42.680241 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 14:43:42.680241 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: from cryptography.utils import int_from_bytes Jun 20 14:43:45.085563 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 14:43:45.086204 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 14:43:45.086303 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 14:43:45.086664 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 14:43:45.086919 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 14:43:45.087301 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.087430 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 14:43:45.087797 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 14:43:45.087876 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.087876 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.088087 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 14:43:45.088233 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.088447 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 14:43:45.088581 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.088679 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 14:43:45.088863 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.089085 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.089229 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.089366 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.089464 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.089706 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.089839 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.090017 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.090151 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.090335 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.090479 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.090623 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.090715 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-5-iscsi {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.090935 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.091026 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.091237 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.091339 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.091544 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.091636 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.091793 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.091896 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.092100 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.092198 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.092402 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-5-iscsi {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.092538 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.092745 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.092838 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.093038 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.093226 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.093329 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.094368 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.094471 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.094573 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.094656 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.094723 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.094787 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.094859 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.094930 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.094930 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.095068 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.095150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.095331 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.095453 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.095572 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.095762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.095858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.096083 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.096199 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.096389 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.096516 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.096806 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-5-iscsi {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.096906 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.097120 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.097205 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.097421 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.097508 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.097733 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.097814 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.098040 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.098152 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.098429 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-5-iscsi {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.098523 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.098730 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.098829 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.099032 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.099144 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.099341 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.099453 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.099653 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.099751 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.099986 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.100072 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.100353 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.100464 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.100671 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.100881 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.101014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.101212 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.101395 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.101515 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.101618 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.101836 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.101921 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.102148 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.102251 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.102459 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.102608 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.102772 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.102859 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.103016 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.103111 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.103320 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.103406 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.103637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.103723 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.103944 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.104038 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.104242 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.104327 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.104495 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.104582 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.104759 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.104870 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.105076 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.105170 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.105389 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.105474 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.105691 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.105776 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.105995 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.106084 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.106236 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.106332 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.106477 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.106589 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.106789 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.106885 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.107101 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.107205 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.107400 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.107487 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.107699 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.107786 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.107997 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.108091 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.108301 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.108387 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.108597 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.108697 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.108918 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.109013 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.109218 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.109305 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.109516 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.109651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.109825 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.109914 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.110130 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.110222 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.110443 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.110549 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.110743 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.110831 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.111055 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.111150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.111401 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.111501 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.111673 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.111767 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.111973 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.112059 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.112292 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.112431 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.112594 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.112758 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.112920 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.113018 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.113233 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.113328 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.113533 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.113618 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.113778 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.113865 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.114074 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.114173 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.114373 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.114473 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.114697 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.114852 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.114987 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.115084 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.115287 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.115382 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.115528 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.115613 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.115919 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.116010 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.116221 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.116306 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.116523 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.116609 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.116843 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.116934 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.117142 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.117244 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.117440 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.117527 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.117734 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.117831 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.118033 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.118118 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.118334 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.118420 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.118631 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.118718 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.118929 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.119021 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.119225 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.119320 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.119520 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.119613 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.119814 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.119900 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.120109 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.120203 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.120405 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.120500 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.120725 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.120814 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.121036 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.121131 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.121333 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.121419 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.121627 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.121714 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.121924 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.122026 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.122222 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.122309 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.122531 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.122625 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.122828 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.122928 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.123128 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.123222 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.123437 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.123524 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.123732 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.123830 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.124023 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.124116 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.124333 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.124418 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.124628 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.124770 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.124950 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.125046 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.125247 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.125333 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.125541 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.125642 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.125836 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.125929 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.126136 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.126231 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.126435 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.126529 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.126730 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.126815 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.127022 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.127106 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.127317 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.127405 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.127612 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.127699 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.127905 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.127991 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.128203 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.128290 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.128495 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.128581 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.128809 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.128899 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.129119 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.129210 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.129430 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.129524 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.129731 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.129831 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.130028 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.130113 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.130321 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.130415 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.130631 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:43:45.130726 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.130960 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.131047 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.131360 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.131451 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.131680 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.131799 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.132005 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.132096 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.132314 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.132401 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.132624 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.132726 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.132954 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.133044 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.133267 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.133365 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.133585 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.133671 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.133912 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.133999 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.134218 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.134303 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.134524 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.134636 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.134827 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.134915 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.135133 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.135218 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.135442 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.135539 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.135763 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.135857 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.136072 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.136158 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.136378 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.136464 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.136685 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.136836 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.137019 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.137107 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.137329 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.137416 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.137649 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.137743 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.137960 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.138046 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.138268 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.138354 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.138573 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.138658 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.138880 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.138979 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.139200 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.139286 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.139515 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.139602 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.139824 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.139927 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.140122 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.140208 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.140424 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.140518 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.140769 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.140873 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.141045 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.141130 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.141353 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.141441 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.141659 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.141754 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.141968 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.142053 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.142272 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.142359 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.142576 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.142671 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.142876 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.143001 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.143176 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.143262 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.143476 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.143572 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.143781 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.143867 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.144088 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.144174 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.144392 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.144478 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.144695 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.144846 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.145019 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.145114 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.145319 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.145405 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.145619 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.145702 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.145918 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.146002 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.146218 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.146350 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.146517 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.146614 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.146814 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.146915 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.147169 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.147270 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.147464 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.147552 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.147777 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.147873 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.148095 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.148181 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.148398 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.148499 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.148737 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.148841 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.149038 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.149125 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.149340 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.149426 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.149642 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.149807 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.149941 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.150029 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.150239 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.150334 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.150541 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.150628 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.150840 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.150927 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.151137 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.151231 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.151448 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.151534 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.151745 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.151831 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.152041 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.152134 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.152345 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.152430 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.152640 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.152783 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.152966 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.153112 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.153274 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.153382 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.153575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.153661 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.153876 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.153972 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.154178 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.154275 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.154480 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.154566 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.154793 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.154894 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.155096 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.155190 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.155396 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.155482 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.155706 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.155799 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.156011 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.156104 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.156331 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.156416 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.156617 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.156730 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.156942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.157029 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.157247 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.157345 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.157543 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.157629 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.157842 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.157927 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.158138 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.158223 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.158438 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.158530 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.158734 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.158818 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.159036 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.159121 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.159334 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.159420 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.159629 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.159722 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.159925 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.160030 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.160218 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.160303 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.160513 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.160612 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.160860 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.160980 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.161162 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.161257 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.161456 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.161541 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.161749 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.161848 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.162043 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.162128 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.162375 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.162463 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.162772 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.162935 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.163115 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.163264 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.163440 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.163535 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.163747 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.163842 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.164056 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.164152 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.164359 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.164451 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.164665 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.164767 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.164991 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.165079 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.165296 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.165381 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.165597 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.165684 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.165901 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.165986 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.166211 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.166297 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.166512 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.166603 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.166818 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.166902 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.167117 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.167210 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.167431 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.167525 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.167731 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.167817 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.168040 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.168134 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.168341 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.168426 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.168644 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.168752 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.168973 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.169071 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.169280 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.169366 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.169591 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.169676 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.169898 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.170013 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.170199 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.170297 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.170501 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.170605 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.170799 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.170894 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.171099 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.171184 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.171397 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.171485 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.171698 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.171793 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.172006 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.172092 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.172304 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.172387 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.172611 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.172703 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.172935 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.173022 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.173248 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.173391 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.173548 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.173636 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.173853 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.173945 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.174149 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.174241 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.174451 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.174537 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.174756 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.174840 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.175062 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.175148 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.175364 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.175451 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.175663 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.175747 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.175966 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.176059 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.176267 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.176350 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.176569 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.176698 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.176898 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.176994 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.177194 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.177323 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.177489 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.177574 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.177792 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.177963 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.178091 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.178179 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.178419 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.178564 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.178783 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.178893 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.179080 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.179175 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.179388 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.179474 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.179691 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.179777 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.179988 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.180073 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.180285 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.180390 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.180585 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.180678 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.180928 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.181026 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.181230 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.181315 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.181529 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.181614 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.181831 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.181917 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.182131 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.182223 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.182431 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.182518 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.182745 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.182830 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.183047 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.183144 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.183341 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.183471 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.183636 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.183722 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.183931 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.184031 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.184256 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.184340 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.184556 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.184641 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.184877 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.184980 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.185187 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.185281 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.185498 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.185582 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.185799 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.185892 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.186104 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.186188 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.186406 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.186493 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.186707 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.186801 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.187014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.187112 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.187316 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.187401 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.187619 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.187706 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.187926 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.188010 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.188224 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.188308 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.188526 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.188619 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.188850 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.188938 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.189164 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.189249 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.189465 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.190047 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.190139 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.190372 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.190488 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.190671 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.190771 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.190975 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.191073 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.191283 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.191380 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.191602 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.191836 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.191933 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.192164 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.192259 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.192469 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.192574 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.192802 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.192917 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.193114 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.193210 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.193425 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.193561 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.193746 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.193888 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.194136 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.194252 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.194445 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.194587 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.194755 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.194888 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.195061 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.195192 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.195370 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.195492 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.195674 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.195793 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.195976 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.196098 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.196279 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.196398 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.196586 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.196701 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.196929 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.197018 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.197235 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.197320 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.197545 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.197633 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.197851 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.197937 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.198170 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.198262 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.198475 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.198561 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.198776 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.198860 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.199074 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.199157 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.199376 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.199463 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.199677 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.199761 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.199994 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.200080 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.200297 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.200390 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.200597 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.200686 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.200921 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.201021 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.201218 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.201313 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.201548 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.201634 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.201844 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.202016 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.202159 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.202251 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.202460 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.202553 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.202762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.202856 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.203069 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.203155 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.203376 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.203460 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.203679 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.203785 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.203977 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.204062 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.204277 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.204361 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.204576 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.204663 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.204902 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.204987 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.205204 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.205289 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.205498 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.205584 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.205795 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.205878 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.206096 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.206180 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.206399 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.206491 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.206697 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.206782 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.206991 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.207075 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.207294 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.207382 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.207592 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.207677 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.207889 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.207983 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.208189 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.208273 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.208484 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.208576 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.208804 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.208905 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.209109 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.209193 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.209427 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.209511 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.209734 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.209828 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.210037 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.210203 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.210344 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.210507 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.210631 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.210819 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.210946 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.211118 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.211304 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.211400 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.211553 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.211700 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.211853 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.212001 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.212160 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.212300 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.212462 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.212605 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.212786 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.212932 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.213093 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.213236 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.213411 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.213535 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.213732 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.213849 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.214034 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.214133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.214342 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.214431 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.214645 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.214747 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.214951 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.215056 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.215251 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.215342 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.215554 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.215641 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.215850 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.215949 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.216148 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.216233 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.216442 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.216526 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.216757 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.216862 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.217063 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.217211 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.217346 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.217480 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.217648 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.217790 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.217945 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.218081 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.218232 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.218373 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.218514 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.218646 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.218815 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.218948 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.219130 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.219264 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.219430 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.219564 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.219727 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.219855 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.220025 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.220168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.220309 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.220442 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.220638 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.220783 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.220976 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.221063 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.221283 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.221368 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.221583 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.221676 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.221896 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.221991 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.222203 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.222296 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.222504 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.222588 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.222804 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.222897 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.223104 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.223190 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.223399 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.223491 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.223706 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.223861 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.224009 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.224096 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.224313 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.224398 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.224609 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.224703 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.224927 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.225014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.225342 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.225458 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.225656 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.225764 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.225952 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.226045 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.226266 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.226354 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.226580 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.226666 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.226894 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.226979 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.227191 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.227275 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.227490 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.227584 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.227792 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.227876 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.228091 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.228175 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.228396 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.228482 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.228699 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.228804 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.229029 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.229113 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.229334 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.229429 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.229634 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.229719 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.229935 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.230107 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.230237 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.230323 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.230533 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.230618 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.230831 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.230924 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.231129 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.231213 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.231423 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.231506 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.231722 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.231815 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.232024 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.232142 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.232320 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.232453 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.232618 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.232780 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.232939 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.233081 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.233240 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.233386 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.233538 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.233690 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.233953 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.234058 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.234252 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.234339 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.234555 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.234648 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.234850 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.234979 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.235150 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.235287 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.235449 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.235593 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.235754 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.235900 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.236058 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.236201 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.236352 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.236500 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.236782 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.236874 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.237087 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.237187 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.237389 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.237484 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.237689 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.237775 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.237984 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.238079 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.238279 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.238374 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.238586 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.238677 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.238898 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.238992 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.239192 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.239310 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.239489 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.239620 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.239786 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.239921 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.240097 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.240332 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.240417 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.240641 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.240786 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.241014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.241217 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.241440 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.241526 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.241764 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.241863 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.242086 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.242205 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.242389 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.242510 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.242701 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.242796 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.243008 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.243114 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.243332 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.243428 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.243652 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.243746 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.243972 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.244102 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.244275 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.244377 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.244579 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.244666 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.244921 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.245023 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.245237 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.245336 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.245540 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.245626 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.245845 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.245941 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.246144 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.246261 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.246458 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.246584 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.246769 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.246892 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.247071 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.247214 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.247383 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.247538 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.247786 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.247872 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.248097 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.248190 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.248397 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.248483 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.248744 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.248834 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.249034 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.249120 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.249338 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.249440 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.249637 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.249723 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.249940 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.250025 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.250237 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.250336 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.250535 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.250620 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.250834 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.250926 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.251134 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.251236 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.251437 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.251523 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.251737 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.251832 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.252035 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.252133 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.252330 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.252424 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.252628 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.252742 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.252964 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.253068 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.253260 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.253348 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.253574 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.253660 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.253879 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.253965 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.254181 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.254277 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.254480 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.254570 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.254776 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.254862 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.255089 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.255181 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.255389 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.255476 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.255686 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.255780 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.255984 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.256083 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.256358 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.256461 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.256709 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.256858 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.257029 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.257115 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.257344 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.257442 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.257668 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.257763 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.257984 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.258068 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.258286 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.258381 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.258599 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.258683 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.258905 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.258992 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.259215 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.259300 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.259517 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.259601 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.259823 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.259908 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.260119 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.260213 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.260417 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.260503 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.260752 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.260853 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.261033 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.261126 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.261329 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.261424 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.261625 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.261710 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.261926 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.262012 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.262223 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.262315 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.262517 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.262609 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.262809 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.262897 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.263121 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.263207 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.263417 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.263514 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.263726 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.263818 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.264022 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.264119 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.264319 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.264426 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.264610 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.264767 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.264929 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.265018 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.265261 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.265360 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.265559 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.265645 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.265883 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.265968 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.266189 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.266283 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.266499 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.266591 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.266813 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.266899 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.267113 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.267199 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.267421 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.267504 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.267728 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.267822 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.268034 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.268121 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.268338 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.268422 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.268651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.268770 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.268982 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.269070 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.269291 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.269377 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.269597 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.269797 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.269892 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.270124 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.270217 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.270436 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.270524 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.270747 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.270843 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.271059 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.271274 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.271368 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.271596 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.271692 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.271928 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.272017 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.272236 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.272322 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.272542 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.272653 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.272873 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.272965 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.273179 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.273266 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.273480 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.273568 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.273782 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.273867 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.274083 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.274174 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.274389 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.274488 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.274699 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.274789 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.275066 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.275160 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.275326 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.275413 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.275653 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.275738 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.275965 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.276133 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.276270 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.276355 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.276573 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.276660 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.276904 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.277005 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.277213 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.277298 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.277524 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.277614 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.277832 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.277935 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.278135 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.278221 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.278441 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.278527 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.278747 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.278833 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.279048 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.279133 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.279348 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.279433 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.279652 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.279739 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.279955 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.280041 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.280256 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.280351 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.280557 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.280645 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.280891 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.280990 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.281196 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.281291 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.281505 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.281606 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.281830 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.282015 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.282142 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.282327 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.282447 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.282655 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.282741 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.282979 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.283145 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.283301 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.283545 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.283631 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.283856 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.283942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.284181 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.284268 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.284502 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.284641 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.284829 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.284930 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.285136 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.285234 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.285439 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.285526 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.285740 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.285826 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.286041 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.286128 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.286340 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.286426 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.286637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.286737 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.286936 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.287023 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.287235 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.287322 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.287643 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.287806 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.288111 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.288213 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.288445 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.288565 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.288789 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.288919 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.289117 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.289214 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.289435 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.289742 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.289828 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.290063 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.290151 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.290367 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.290454 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.290677 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.290839 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.290980 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.291119 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.291283 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.291420 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.291570 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.291713 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.291878 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.292007 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.292178 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.292315 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.292481 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.292629 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.292809 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.292940 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.293099 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.293233 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.293377 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.293518 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.293680 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.293823 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.293984 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.294118 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.294286 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.294418 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.294576 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.294719 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.294859 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.294942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.295155 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.295243 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.295455 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.295540 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.295759 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.295846 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.296056 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.296141 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.296355 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.296441 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.296652 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.296770 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.296976 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.297068 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.297274 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.297359 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.297571 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.297664 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.297866 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.297952 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.298167 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.298259 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.298460 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.298555 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.298765 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.298851 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.299063 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.299148 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.299365 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.299465 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.299661 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.299746 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.299961 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.300046 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.300282 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.300375 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.300592 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.300679 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.300911 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.301005 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.301210 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.301297 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.301517 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.301603 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.301819 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.302064 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.302159 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.302395 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.302481 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.302713 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.302798 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.303039 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.303133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.303445 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.303541 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.303815 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.304143 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.304234 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.304503 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.304598 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.304846 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.304940 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.305155 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.305253 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.305466 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.305552 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.305775 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.305875 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.306077 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.306178 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.306379 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.306465 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.306683 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.306767 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.306990 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.307084 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.307294 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.307380 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.307599 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.307682 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.307901 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.307995 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.308203 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.308344 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.308520 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.308633 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.308829 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.308918 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.309130 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.309215 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.309432 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.309518 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.309733 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.309828 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.310036 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.310123 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.310337 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.310430 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.310637 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.310723 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.310946 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.311031 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.311260 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.311352 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.311568 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.311688 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.311874 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.311960 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.312179 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.312416 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.312505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.312584 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.312804 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.312900 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.313110 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.313196 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.313410 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.313528 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.313710 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.313840 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.314016 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.314158 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.314338 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.314477 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.315062 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.315165 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.315256 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.315406 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.315643 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.315728 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.315947 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.316041 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.316256 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.316342 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.316566 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.316652 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.316892 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.317003 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.317206 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.317292 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.317519 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.317604 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.317820 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.317920 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.318132 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.318218 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.318435 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.318522 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.318749 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.318875 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.319112 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.319210 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.319426 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.319514 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.319734 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.319885 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.320039 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.320187 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.320343 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.320487 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.320648 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.320812 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.320972 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.321104 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.321276 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.321417 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.321581 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.321722 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.321880 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.322022 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.322185 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.322320 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.322485 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.322623 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.322786 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.322920 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.323086 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.323219 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.323387 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.323517 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.323688 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.323815 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.323988 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.324115 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.324291 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.324410 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.324592 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.324707 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.324916 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.325015 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.325217 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.325315 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.325515 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.325602 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.325820 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.325915 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.326146 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.326232 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.326457 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.326541 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.326754 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.326841 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.327048 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.327133 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.327347 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.327432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.327643 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.327729 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.327968 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.328055 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.328285 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.328369 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.328592 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.328678 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.328928 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.329026 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.329231 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.329329 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.329544 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.329629 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.329845 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.329930 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.330151 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.330248 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.330458 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.330544 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.330763 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.330856 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.331063 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.331203 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.331368 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.331462 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.331676 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.331761 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.331980 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.332089 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.332280 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.332367 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.332582 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.332667 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.332908 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.332997 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.333211 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.333297 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.333527 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.333610 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.333834 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.333921 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.334132 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.334217 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.334476 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.334563 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.334790 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.334946 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.335100 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.335191 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.335397 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.335529 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.335704 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.335804 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.336015 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.336111 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.336327 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.336425 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.336629 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.336746 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.336962 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.337050 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.337266 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.337368 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.337571 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.337673 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.337879 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.337971 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.338185 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.338282 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.338503 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.338592 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.338826 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.338913 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.339129 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.339226 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.339447 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.339535 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.339762 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.339850 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.340065 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.340152 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.340307 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 14:43:45.340401 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.340732 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.341063 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.341371 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.341677 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.341977 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:43:45.342213 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 14:43:45.402284 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO dbcounter [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] Registered counter for database nova_api Jun 20 14:43:45.496357 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO dbcounter [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] Registered counter for database nova_api Jun 20 14:43:45.517397 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG oslo_db.sqlalchemy.engines [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:43:45.518849 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_db.sqlalchemy.engines [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:43:45.525862 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG dbcounter [-] [109599] Writer thread running {{(pid=109599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:43:45.525986 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writer thread running {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:43:45.582696 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.context [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),316254da-3fa1-408c-aacc-695744828597(cell1) {{(pid=109599) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 14:43:45.583340 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.context [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),316254da-3fa1-408c-aacc-695744828597(cell1) {{(pid=109600) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 14:43:45.587183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG oslo_concurrency.lockutils [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:43:45.587596 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:43:45.588967 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG oslo_concurrency.lockutils [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:43:45.589392 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:43:45.589940 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG oslo_concurrency.lockutils [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:43:45.590324 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:43:45.592162 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG oslo_concurrency.lockutils [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:43:45.592408 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:43:45.594346 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO dbcounter [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] Registered counter for database nova_cell0 Jun 20 14:43:45.594568 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO dbcounter [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] Registered counter for database nova_cell0 Jun 20 14:43:45.598635 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO dbcounter [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] Registered counter for database nova_cell1 Jun 20 14:43:45.598818 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO dbcounter [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] Registered counter for database nova_cell1 Jun 20 14:43:45.606553 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG oslo_db.sqlalchemy.engines [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:43:45.607866 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG oslo_db.sqlalchemy.engines [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:43:45.611587 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_db.sqlalchemy.engines [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:43:45.613700 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_db.sqlalchemy.engines [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:43:45.613827 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG dbcounter [-] [109599] Writer thread running {{(pid=109599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:43:45.618650 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG dbcounter [-] [109599] Writer thread running {{(pid=109599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:43:45.619331 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writer thread running {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:43:45.759777 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writer thread running {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:43:45.769242 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO dbcounter [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] Registered counter for database nova_cell0 Jun 20 14:43:45.773197 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO dbcounter [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] Registered counter for database nova_cell0 Jun 20 14:43:45.779292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_db.sqlalchemy.engines [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:43:45.781335 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG oslo_db.sqlalchemy.engines [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:43:45.784549 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writer thread running {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:43:45.785772 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG dbcounter [-] [109599] Writer thread running {{(pid=109599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:43:46.119187 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: WARNING keystonemiddleware.auth_token [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 14:43:46.124609 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: WARNING keystonemiddleware.auth_token [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 14:43:46.126482 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: WARNING keystonemiddleware.auth_token [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 14:43:46.132596 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: WARNING keystonemiddleware.auth_token [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 14:43:46.466789 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: WARNING keystonemiddleware.auth_token [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 14:43:46.472899 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: WARNING keystonemiddleware.auth_token [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 14:43:46.478405 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e32d1ce9c0 pid: 109600 (default app) Jun 20 14:43:46.480473 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:43:46.481700 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001782 Jun 20 14:43:46.482114 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Mon Jun 20 14:43:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:43:46.482271 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: WARNING keystonemiddleware.auth_token [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 14:43:46.488234 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: WARNING keystonemiddleware.auth_token [None req-87a9d489-95fd-4b9b-a1cb-f5f9654cec55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 14:43:46.493618 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e32d1ce9c0 pid: 109599 (default app) Jun 20 14:45:01.781705 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:01.782715 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 20 14:45:01.783108 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 14:45:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:01.801684 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG dbcounter [-] [109599] Writing DB stats nova_api:SELECT=3 {{(pid=109599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:45:01.802974 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG dbcounter [-] [109599] Writing DB stats nova_cell1:SELECT=3 {{(pid=109599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:45:01.803845 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG dbcounter [-] [109599] Writing DB stats nova_cell0:SELECT=3 {{(pid=109599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:45:01.804745 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG dbcounter [-] [109599] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:45:02.237553 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-671bc7b4-e4ea-4ab8-9296-38cce7ccf47f admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:02.268572 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-671bc7b4-e4ea-4ab8-9296-38cce7ccf47f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.478399 Jun 20 14:45:02.269688 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1291 bytes} [Mon Jun 20 14:45:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:45:04.349973 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:04.350995 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-e41d08fd-c678-4bcf-b1c2-fd70008683ab None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 20 14:45:04.351374 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 14:45:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:04.410618 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-9f18df73-4021-435a-a71a-322202ba705d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:04.428434 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:45:04.428434 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: warnings.warn(msg) Jun 20 14:45:04.458577 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-9f18df73-4021-435a-a71a-322202ba705d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101121 Jun 20 14:45:04.462451 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 14:45:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 14:45:04.472363 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_api:SELECT=3 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:45:04.473654 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_cell1:SELECT=3 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:45:04.474651 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_cell0:SELECT=3 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:45:04.475598 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:45:04.688028 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-f60a004d-a068-46ac-b9b1-64bf65d27899 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:04.690779 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:45:04.690779 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: warnings.warn(msg) Jun 20 14:45:04.753147 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-f60a004d-a068-46ac-b9b1-64bf65d27899 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285790 Jun 20 14:45:04.756932 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1335 bytes} [Mon Jun 20 14:45:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:45:06.808162 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-9f18df73-4021-435a-a71a-322202ba705d admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:06.809206 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-9f18df73-4021-435a-a71a-322202ba705d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jun 20 14:45:06.809600 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 14:45:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:06.922459 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-3712a3bd-a09b-4477-a7d1-7359220a157f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:06.941027 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:45:06.941027 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: warnings.warn(msg) Jun 20 14:45:06.961393 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-3712a3bd-a09b-4477-a7d1-7359220a157f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145250 Jun 20 14:45:06.961958 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 14:45:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:45:06.974252 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-c7a837b9-d6c8-4a48-9a8e-5e4b614c9d34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:06.975763 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:45:06.975763 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: warnings.warn(msg) Jun 20 14:45:07.007694 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-c7a837b9-d6c8-4a48-9a8e-5e4b614c9d34 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037274 Jun 20 14:45:07.008454 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1335 bytes} [Mon Jun 20 14:45:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:45:09.063120 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-3712a3bd-a09b-4477-a7d1-7359220a157f admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:09.064442 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-3712a3bd-a09b-4477-a7d1-7359220a157f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001790 Jun 20 14:45:09.065158 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 14:45:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:09.128080 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-85191e05-4025-4f18-b131-cce2674c0456 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "disk": 10}} {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:09.147557 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-85191e05-4025-4f18-b131-cce2674c0456 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076154 Jun 20 14:45:09.148093 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 14:45:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 14:45:09.160154 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-3a1b5880-c435-4a76-88e3-25996e7854d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:09.183467 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-3a1b5880-c435-4a76-88e3-25996e7854d2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027237 Jun 20 14:45:09.184364 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1335 bytes} [Mon Jun 20 14:45:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:45:11.276986 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-85191e05-4025-4f18-b131-cce2674c0456 admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:11.278005 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-85191e05-4025-4f18-b131-cce2674c0456 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jun 20 14:45:11.278378 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 14:45:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:11.339405 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-b077ffd3-60cb-4c9e-b72c-2b3cc0f0b6a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "id": "d3", "vcpus": 2, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:11.357366 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-b077ffd3-60cb-4c9e-b72c-2b3cc0f0b6a5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073058 Jun 20 14:45:11.357914 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 14:45:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:45:11.369820 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-c6d82b2f-1ad4-44b8-b9b5-5a9ceb3c9a22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:11.392420 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-c6d82b2f-1ad4-44b8-b9b5-5a9ceb3c9a22 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026253 Jun 20 14:45:11.393024 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1335 bytes} [Mon Jun 20 14:45:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:45:13.447381 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-b077ffd3-60cb-4c9e-b72c-2b3cc0f0b6a5 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:13.448475 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-b077ffd3-60cb-4c9e-b72c-2b3cc0f0b6a5 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jun 20 14:45:13.448903 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 14:45:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:13.506467 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-ab3e6383-ff98-4960-b918-6af725cd3007 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 20}} {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:13.524707 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-ab3e6383-ff98-4960-b918-6af725cd3007 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070238 Jun 20 14:45:13.525279 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 14:45:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 14:45:13.537390 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-3d94207c-6503-4b50-a3c3-47205001c321 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:13.561170 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-3d94207c-6503-4b50-a3c3-47205001c321 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027631 Jun 20 14:45:13.561740 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1335 bytes} [Mon Jun 20 14:45:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:45:15.635374 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-ab3e6383-ff98-4960-b918-6af725cd3007 admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:15.636420 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-ab3e6383-ff98-4960-b918-6af725cd3007 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 20 14:45:15.636843 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 14:45:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:15.699666 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-45637f6b-7bb2-4e90-8c30-948a7f840207 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:15.723794 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-45637f6b-7bb2-4e90-8c30-948a7f840207 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080639 Jun 20 14:45:15.724645 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1291 bytes} [Mon Jun 20 14:45:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:45:17.823546 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-ab3e6383-ff98-4960-b918-6af725cd3007 admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:17.824569 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-ab3e6383-ff98-4960-b918-6af725cd3007 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 20 14:45:17.825032 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 14:45:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:17.885233 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-d781b0b4-b7ec-49c0-b49a-4924f13c772f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "id": "1", "os-flavor-access:is_public": true}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:17.907158 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-d781b0b4-b7ec-49c0-b49a-4924f13c772f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076246 Jun 20 14:45:17.907817 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 14:45:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:45:17.922327 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-8b219389-7a43-481a-9dcf-0bf90d5adc24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:17.952345 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-8b219389-7a43-481a-9dcf-0bf90d5adc24 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034551 Jun 20 14:45:17.953456 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1332 bytes} [Mon Jun 20 14:45:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:45:20.221697 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-d781b0b4-b7ec-49c0-b49a-4924f13c772f admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:20.223198 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-d781b0b4-b7ec-49c0-b49a-4924f13c772f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001989 Jun 20 14:45:20.223625 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 14:45:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:20.292420 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-40cbf11e-c4fe-4bec-8cac-69a4fd9f9f35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "name": "m1.small"}} {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:20.316016 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-40cbf11e-c4fe-4bec-8cac-69a4fd9f9f35 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084838 Jun 20 14:45:20.318278 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 14:45:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:45:20.333137 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-ab9cee95-0854-4d65-9ea7-cb5288d8c06c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:20.360375 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-ab9cee95-0854-4d65-9ea7-cb5288d8c06c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033026 Jun 20 14:45:20.361004 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1332 bytes} [Mon Jun 20 14:45:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:45:22.443845 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-40cbf11e-c4fe-4bec-8cac-69a4fd9f9f35 admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:22.444902 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-40cbf11e-c4fe-4bec-8cac-69a4fd9f9f35 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 20 14:45:22.445306 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 14:45:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:22.506938 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-f5bc9e9d-2c13-4413-8f4a-2824a8c533f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "disk": 40, "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:22.530688 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-f5bc9e9d-2c13-4413-8f4a-2824a8c533f9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079220 Jun 20 14:45:22.531406 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 14:45:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 14:45:22.543459 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-d347c00f-6ab3-485a-9a3a-74feb209df08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:22.573451 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-d347c00f-6ab3-485a-9a3a-74feb209df08 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033421 Jun 20 14:45:22.574200 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1332 bytes} [Mon Jun 20 14:45:22 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:45:24.751261 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-f5bc9e9d-2c13-4413-8f4a-2824a8c533f9 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:24.752278 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-f5bc9e9d-2c13-4413-8f4a-2824a8c533f9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 20 14:45:24.752696 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 14:45:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:24.814222 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-d03c7f4b-fbe4-4e90-833a-3011b0dbc2e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "swap": 0}} {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:24.834530 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-d03c7f4b-fbe4-4e90-833a-3011b0dbc2e5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075660 Jun 20 14:45:24.835370 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 14:45:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:45:24.847462 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-36406f4a-e3de-4772-ad76-5d88e29cae8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:24.871327 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-36406f4a-e3de-4772-ad76-5d88e29cae8d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027852 Jun 20 14:45:24.871894 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1332 bytes} [Mon Jun 20 14:45:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:45:26.923293 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-d03c7f4b-fbe4-4e90-833a-3011b0dbc2e5 admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:26.924302 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-d03c7f4b-fbe4-4e90-833a-3011b0dbc2e5 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 20 14:45:26.924841 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 14:45:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:26.991789 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-82c7bf9d-9592-467a-a6bb-5e4dd9ff7577 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "id": "5"}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:27.013899 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-82c7bf9d-9592-467a-a6bb-5e4dd9ff7577 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082496 Jun 20 14:45:27.014764 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1282 bytes} [Mon Jun 20 14:45:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 14:45:27.027580 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-c61978de-7087-4c2c-b69a-a41e3752103b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:27.056365 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-c61978de-7087-4c2c-b69a-a41e3752103b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032543 Jun 20 14:45:27.057202 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1332 bytes} [Mon Jun 20 14:45:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:45:51.418296 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-82c7bf9d-9592-467a-a6bb-5e4dd9ff7577 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:51.419306 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-82c7bf9d-9592-467a-a6bb-5e4dd9ff7577 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 20 14:45:51.419709 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 14:45:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:51.433757 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG dbcounter [-] [109599] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:45:51.490013 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-38c20be0-156e-40c9-813b-13407122385b admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:51.506716 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-38c20be0-156e-40c9-813b-13407122385b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.080510 Jun 20 14:45:51.507243 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1291 bytes} [Mon Jun 20 14:45:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:45:52.427760 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-82c7bf9d-9592-467a-a6bb-5e4dd9ff7577 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:52.428833 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-82c7bf9d-9592-467a-a6bb-5e4dd9ff7577 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002531 Jun 20 14:45:52.429207 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 14:45:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:52.628165 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-f9fc98c0-1743-4e76-a84d-92d195a8ca8b admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:52.634096 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.wsgi [None req-f9fc98c0-1743-4e76-a84d-92d195a8ca8b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-f9fc98c0-1743-4e76-a84d-92d195a8ca8b admin admin] Request method failure captured: Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Accept: application/json Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Accept-Encoding: gzip, deflate Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Connection: keep-alive Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Content-Length: 0 Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Host: 10.222.0.23 Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Openstack-Api-Version: compute 2.90 Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Openstack-System-Scope: None Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: User-Agent: python-novaclient Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Auth-Token: gAAAAABisIgg_0PQY7C5uI9rsyauITcMKbR8saEkgK1XxBptPSszROteyjqTlXCDnIYzi0djDqdsBH8-x1oYUel1Uywac6wTu8DJfbqJRXKJL-HklRTACg5EoZtf_BT5DHkKRVruMMHVPuHCiH6AglXYeAix-wQpiZSgwusb3TbUhwgxSSCWw14 Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Domain-Id: None Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Domain-Name: None Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Identity-Status: Confirmed Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Is-Admin-Project: True Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Project-Domain-Id: default Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Project-Domain-Name: Default Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Project-Id: 995754b005f44c748381f029d2a25afd Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Project-Name: admin Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Role: reader,member,admin Jun 20 14:45:52.637432 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Roles: reader,member,admin Jun 20 14:45:52.639070 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_995754b005f44c748381f029d2a25afd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/995754b005f44c748381f029d2a25afd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/995754b005f44c748381f029d2a25afd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/995754b005f44c748381f029d2a25afd"}]}] Jun 20 14:45:52.639070 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Tenant: admin Jun 20 14:45:52.639070 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Tenant-Id: 995754b005f44c748381f029d2a25afd Jun 20 14:45:52.639070 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Tenant-Name: admin Jun 20 14:45:52.639070 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-User: admin Jun 20 14:45:52.639070 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-User-Domain-Id: default Jun 20 14:45:52.639070 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-User-Domain-Name: Default Jun 20 14:45:52.639070 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-User-Id: b3edecff66d3402591d4ea9f1c0735a7 Jun 20 14:45:52.639070 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-User-Name: admin Jun 20 14:45:52.639070 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: method: > Jun 20 14:45:52.639070 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: exception: Flavor 42 could not be found. Jun 20 14:45:52.639070 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: action_args: {'id': '42'} Jun 20 14:45:52.639070 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:45:52.639070 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:45:52.640014 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Jun 20 14:45:52.641168 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-f9fc98c0-1743-4e76-a84d-92d195a8ca8b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:45:52.642238 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-f9fc98c0-1743-4e76-a84d-92d195a8ca8b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.071627 Jun 20 14:45:52.642238 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Jun 20 14:45:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:52.648748 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-9722a65c-12ab-4cc1-93ab-9346a28f8c3a admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:52.651718 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:45:52.671253 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-9722a65c-12ab-4cc1-93ab-9346a28f8c3a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026111 Jun 20 14:45:52.671789 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Jun 20 14:45:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:45:52.681674 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-20601ba3-a899-455a-bb5e-4648308d0c82 admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:52.703845 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-20601ba3-a899-455a-bb5e-4648308d0c82 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025759 Jun 20 14:45:52.704387 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Jun 20 14:45:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:45:52.713938 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-fec5571d-a64a-4b5f-a46b-033367ce2bce admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:52.719947 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.wsgi [None req-fec5571d-a64a-4b5f-a46b-033367ce2bce admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-fec5571d-a64a-4b5f-a46b-033367ce2bce admin admin] Request method failure captured: Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Accept: application/json Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Accept-Encoding: gzip, deflate Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Connection: keep-alive Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Content-Length: 0 Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Host: 10.222.0.23 Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Openstack-Api-Version: compute 2.90 Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Openstack-System-Scope: None Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: User-Agent: python-novaclient Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Auth-Token: gAAAAABisIgg_0PQY7C5uI9rsyauITcMKbR8saEkgK1XxBptPSszROteyjqTlXCDnIYzi0djDqdsBH8-x1oYUel1Uywac6wTu8DJfbqJRXKJL-HklRTACg5EoZtf_BT5DHkKRVruMMHVPuHCiH6AglXYeAix-wQpiZSgwusb3TbUhwgxSSCWw14 Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Domain-Id: None Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Domain-Name: None Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Identity-Status: Confirmed Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Is-Admin-Project: True Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Project-Domain-Id: default Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Project-Domain-Name: Default Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Project-Id: 995754b005f44c748381f029d2a25afd Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Project-Name: admin Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Role: reader,member,admin Jun 20 14:45:52.723575 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Roles: reader,member,admin Jun 20 14:45:52.725133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_995754b005f44c748381f029d2a25afd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/995754b005f44c748381f029d2a25afd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/995754b005f44c748381f029d2a25afd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/995754b005f44c748381f029d2a25afd"}]}] Jun 20 14:45:52.725133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Tenant: admin Jun 20 14:45:52.725133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Tenant-Id: 995754b005f44c748381f029d2a25afd Jun 20 14:45:52.725133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Tenant-Name: admin Jun 20 14:45:52.725133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-User: admin Jun 20 14:45:52.725133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-User-Domain-Id: default Jun 20 14:45:52.725133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-User-Domain-Name: Default Jun 20 14:45:52.725133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-User-Id: b3edecff66d3402591d4ea9f1c0735a7 Jun 20 14:45:52.725133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-User-Name: admin Jun 20 14:45:52.725133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: method: > Jun 20 14:45:52.725133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: exception: Flavor 42 could not be found. Jun 20 14:45:52.725133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: action_args: {'id': '42'} Jun 20 14:45:52.725133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:45:52.725133 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:45:52.726092 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 20 14:45:52.727183 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-fec5571d-a64a-4b5f-a46b-033367ce2bce admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:45:52.728193 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-fec5571d-a64a-4b5f-a46b-033367ce2bce admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014624 Jun 20 14:45:52.728193 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Jun 20 14:45:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:53.549290 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-20601ba3-a899-455a-bb5e-4648308d0c82 admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:53.550322 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-20601ba3-a899-455a-bb5e-4648308d0c82 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 20 14:45:53.550712 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 14:45:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:53.745977 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-7622b7b3-3175-422c-bd08-abab10ead316 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:53.753767 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.wsgi [None req-7622b7b3-3175-422c-bd08-abab10ead316 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-7622b7b3-3175-422c-bd08-abab10ead316 admin admin] Request method failure captured: Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Accept: application/json Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Accept-Encoding: gzip, deflate Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Connection: keep-alive Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Content-Length: 0 Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Host: 10.222.0.23 Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Openstack-Api-Version: compute 2.90 Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Openstack-System-Scope: None Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: User-Agent: python-novaclient Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Auth-Token: gAAAAABisIghbxfwvahbeJM4SkHH5wsBO7rV4rpVc4l1CIooOe48_ZpIpFyAEz9MBRWxjGwAkjLvH0lfUtUkJY1lvgLOv8TLOBQu-AXlm2_6wAZCcAjDUZd4P3qYZleVsMAUvd4KETI5tVtZEKOSg0S85Z6eOBVOaDX8NhmS_gWkqpLk7FDy8fs Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Domain-Id: None Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Domain-Name: None Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Identity-Status: Confirmed Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Is-Admin-Project: True Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Project-Domain-Id: default Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Project-Domain-Name: Default Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Project-Id: 995754b005f44c748381f029d2a25afd Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Project-Name: admin Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Role: reader,member,admin Jun 20 14:45:53.755292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Roles: reader,member,admin Jun 20 14:45:53.756796 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_995754b005f44c748381f029d2a25afd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/995754b005f44c748381f029d2a25afd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/995754b005f44c748381f029d2a25afd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/995754b005f44c748381f029d2a25afd"}]}] Jun 20 14:45:53.756796 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Tenant: admin Jun 20 14:45:53.756796 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Tenant-Id: 995754b005f44c748381f029d2a25afd Jun 20 14:45:53.756796 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Tenant-Name: admin Jun 20 14:45:53.756796 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-User: admin Jun 20 14:45:53.756796 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-User-Domain-Id: default Jun 20 14:45:53.756796 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-User-Domain-Name: Default Jun 20 14:45:53.756796 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-User-Id: b3edecff66d3402591d4ea9f1c0735a7 Jun 20 14:45:53.756796 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-User-Name: admin Jun 20 14:45:53.756796 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: method: > Jun 20 14:45:53.756796 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: exception: Flavor 84 could not be found. Jun 20 14:45:53.756796 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: action_args: {'id': '84'} Jun 20 14:45:53.756796 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:45:53.756796 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:45:53.757600 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 20 14:45:53.758657 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-7622b7b3-3175-422c-bd08-abab10ead316 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:45:53.759656 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-7622b7b3-3175-422c-bd08-abab10ead316 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.070048 Jun 20 14:45:53.759656 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Jun 20 14:45:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:53.766556 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-78d1d956-d141-41b0-bd12-f495a994fc50 admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:53.781186 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-78d1d956-d141-41b0-bd12-f495a994fc50 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018149 Jun 20 14:45:53.781733 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Jun 20 14:45:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:45:53.794081 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-e399656d-574d-43e8-98ef-eecbee48dcba admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:53.809515 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-e399656d-574d-43e8-98ef-eecbee48dcba admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021150 Jun 20 14:45:53.810023 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Jun 20 14:45:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:45:53.819906 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-1c0e63d7-8e63-46a9-bd1a-262019a5149e admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:53.825609 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.wsgi [None req-1c0e63d7-8e63-46a9-bd1a-262019a5149e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-1c0e63d7-8e63-46a9-bd1a-262019a5149e admin admin] Request method failure captured: Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Accept: application/json Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Accept-Encoding: gzip, deflate Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Connection: keep-alive Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Content-Length: 0 Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Host: 10.222.0.23 Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Openstack-Api-Version: compute 2.90 Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Openstack-System-Scope: None Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: User-Agent: python-novaclient Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Auth-Token: gAAAAABisIghbxfwvahbeJM4SkHH5wsBO7rV4rpVc4l1CIooOe48_ZpIpFyAEz9MBRWxjGwAkjLvH0lfUtUkJY1lvgLOv8TLOBQu-AXlm2_6wAZCcAjDUZd4P3qYZleVsMAUvd4KETI5tVtZEKOSg0S85Z6eOBVOaDX8NhmS_gWkqpLk7FDy8fs Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Domain-Id: None Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Domain-Name: None Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Identity-Status: Confirmed Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Is-Admin-Project: True Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Project-Domain-Id: default Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Project-Domain-Name: Default Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Project-Id: 995754b005f44c748381f029d2a25afd Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Project-Name: admin Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Role: reader,member,admin Jun 20 14:45:53.827183 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Roles: reader,member,admin Jun 20 14:45:53.828651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_995754b005f44c748381f029d2a25afd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/995754b005f44c748381f029d2a25afd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/995754b005f44c748381f029d2a25afd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/995754b005f44c748381f029d2a25afd"}]}] Jun 20 14:45:53.828651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Tenant: admin Jun 20 14:45:53.828651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Tenant-Id: 995754b005f44c748381f029d2a25afd Jun 20 14:45:53.828651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Tenant-Name: admin Jun 20 14:45:53.828651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-User: admin Jun 20 14:45:53.828651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-User-Domain-Id: default Jun 20 14:45:53.828651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-User-Domain-Name: Default Jun 20 14:45:53.828651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-User-Id: b3edecff66d3402591d4ea9f1c0735a7 Jun 20 14:45:53.828651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-User-Name: admin Jun 20 14:45:53.828651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: method: > Jun 20 14:45:53.828651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: exception: Flavor 84 could not be found. Jun 20 14:45:53.828651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: action_args: {'id': '84'} Jun 20 14:45:53.828651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:45:53.828651 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:45:53.835540 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Jun 20 14:45:53.836800 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-1c0e63d7-8e63-46a9-bd1a-262019a5149e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:45:53.838000 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-1c0e63d7-8e63-46a9-bd1a-262019a5149e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012286 Jun 20 14:45:53.838000 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Jun 20 14:45:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 20 14:45:54.651345 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-e399656d-574d-43e8-98ef-eecbee48dcba admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:54.652355 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-e399656d-574d-43e8-98ef-eecbee48dcba admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 20 14:45:54.652765 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 14:45:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:54.856552 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-ba401c7c-9052-440a-b54f-88c95e31d707 admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:54.865143 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.wsgi [None req-ba401c7c-9052-440a-b54f-88c95e31d707 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-ba401c7c-9052-440a-b54f-88c95e31d707 admin admin] Request method failure captured: Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Accept: application/json Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Accept-Encoding: gzip, deflate Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Connection: keep-alive Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Content-Length: 0 Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Host: 10.222.0.23 Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Openstack-Api-Version: compute 2.90 Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Openstack-System-Scope: None Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: User-Agent: python-novaclient Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Auth-Token: gAAAAABisIgiRAbqt5IJ5fJdPczlDkldhxXGwQG-E-92jeg-ngXAUr_uoEtyVgTEFYTrXAo5ZzhqoshODpHYNs3yIuvE0zSIbKHsj1HW2Z4CAeeKqNhxzAv7mJPP3IYr5_95zazx6xXdb_Z303DaqNn5tvmjA2vkmkt4PoPPtDjxQ3j_jJ6VamI Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Domain-Id: None Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Domain-Name: None Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Identity-Status: Confirmed Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Is-Admin-Project: True Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Project-Domain-Id: default Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Project-Domain-Name: Default Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Project-Id: 995754b005f44c748381f029d2a25afd Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Project-Name: admin Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Role: reader,member,admin Jun 20 14:45:54.867150 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Roles: reader,member,admin Jun 20 14:45:54.868762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_995754b005f44c748381f029d2a25afd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/995754b005f44c748381f029d2a25afd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/995754b005f44c748381f029d2a25afd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/995754b005f44c748381f029d2a25afd"}]}] Jun 20 14:45:54.868762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Tenant: admin Jun 20 14:45:54.868762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Tenant-Id: 995754b005f44c748381f029d2a25afd Jun 20 14:45:54.868762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-Tenant-Name: admin Jun 20 14:45:54.868762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-User: admin Jun 20 14:45:54.868762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-User-Domain-Id: default Jun 20 14:45:54.868762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-User-Domain-Name: Default Jun 20 14:45:54.868762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-User-Id: b3edecff66d3402591d4ea9f1c0735a7 Jun 20 14:45:54.868762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: X-User-Name: admin Jun 20 14:45:54.868762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: method: > Jun 20 14:45:54.868762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: exception: Flavor 451 could not be found. Jun 20 14:45:54.868762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: action_args: {'id': '451'} Jun 20 14:45:54.868762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:45:54.868762 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:45:54.869637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: ERROR nova.api.openstack.wsgi Jun 20 14:45:54.870942 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-ba401c7c-9052-440a-b54f-88c95e31d707 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:45:54.872172 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-ba401c7c-9052-440a-b54f-88c95e31d707 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.079813 Jun 20 14:45:54.872172 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Jun 20 14:45:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:54.878689 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-b508aaf1-18c5-4128-aa66-f13110664784 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:54.892870 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-b508aaf1-18c5-4128-aa66-f13110664784 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017546 Jun 20 14:45:54.893394 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Jun 20 14:45:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:45:54.902637 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-e1777904-2c1a-42b9-b5f3-1f3e6d5a280d admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:54.917458 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-e1777904-2c1a-42b9-b5f3-1f3e6d5a280d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018282 Jun 20 14:45:54.917974 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Jun 20 14:45:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:45:54.927136 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-ccb6a471-0691-44a0-b5a7-a86a5f776b36 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:54.932522 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.wsgi [None req-ccb6a471-0691-44a0-b5a7-a86a5f776b36 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-ccb6a471-0691-44a0-b5a7-a86a5f776b36 admin admin] Request method failure captured: Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Accept: application/json Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Accept-Encoding: gzip, deflate Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Connection: keep-alive Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Content-Length: 0 Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Host: 10.222.0.23 Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Openstack-Api-Version: compute 2.90 Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Openstack-System-Scope: None Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: User-Agent: python-novaclient Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Auth-Token: gAAAAABisIgiRAbqt5IJ5fJdPczlDkldhxXGwQG-E-92jeg-ngXAUr_uoEtyVgTEFYTrXAo5ZzhqoshODpHYNs3yIuvE0zSIbKHsj1HW2Z4CAeeKqNhxzAv7mJPP3IYr5_95zazx6xXdb_Z303DaqNn5tvmjA2vkmkt4PoPPtDjxQ3j_jJ6VamI Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Domain-Id: None Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Domain-Name: None Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Identity-Status: Confirmed Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Is-Admin-Project: True Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Project-Domain-Id: default Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Project-Domain-Name: Default Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Project-Id: 995754b005f44c748381f029d2a25afd Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Project-Name: admin Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Role: reader,member,admin Jun 20 14:45:54.934053 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Roles: reader,member,admin Jun 20 14:45:54.935490 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_995754b005f44c748381f029d2a25afd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/995754b005f44c748381f029d2a25afd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/995754b005f44c748381f029d2a25afd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/995754b005f44c748381f029d2a25afd"}]}] Jun 20 14:45:54.935490 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Tenant: admin Jun 20 14:45:54.935490 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Tenant-Id: 995754b005f44c748381f029d2a25afd Jun 20 14:45:54.935490 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-Tenant-Name: admin Jun 20 14:45:54.935490 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-User: admin Jun 20 14:45:54.935490 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-User-Domain-Id: default Jun 20 14:45:54.935490 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-User-Domain-Name: Default Jun 20 14:45:54.935490 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-User-Id: b3edecff66d3402591d4ea9f1c0735a7 Jun 20 14:45:54.935490 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: X-User-Name: admin Jun 20 14:45:54.935490 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: method: > Jun 20 14:45:54.935490 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: exception: Flavor 451 could not be found. Jun 20 14:45:54.935490 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: action_args: {'id': '451'} Jun 20 14:45:54.935490 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:45:54.935490 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:45:54.936505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: ERROR nova.api.openstack.wsgi Jun 20 14:45:54.937858 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-ccb6a471-0691-44a0-b5a7-a86a5f776b36 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:45:54.939628 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-ccb6a471-0691-44a0-b5a7-a86a5f776b36 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011845 Jun 20 14:45:54.939628 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Jun 20 14:45:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:55.764420 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-e1777904-2c1a-42b9-b5f3-1f3e6d5a280d admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:55.765482 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-e1777904-2c1a-42b9-b5f3-1f3e6d5a280d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 20 14:45:55.765873 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 14:45:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:55.975902 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-c474561f-28ca-412b-8f7a-098d46810db9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:56.003618 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-c474561f-28ca-412b-8f7a-098d46810db9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.089322 Jun 20 14:45:56.004160 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Jun 20 14:45:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:45:56.831625 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-e1777904-2c1a-42b9-b5f3-1f3e6d5a280d admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:56.833206 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-e1777904-2c1a-42b9-b5f3-1f3e6d5a280d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001934 Jun 20 14:45:56.833820 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 14:45:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:57.043506 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-06bb7752-5134-4e25-8398-c383bb3b662a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:57.064506 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-06bb7752-5134-4e25-8398-c383bb3b662a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.088718 Jun 20 14:45:57.065097 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Jun 20 14:45:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:45:57.876667 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-e1777904-2c1a-42b9-b5f3-1f3e6d5a280d admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:57.877777 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-e1777904-2c1a-42b9-b5f3-1f3e6d5a280d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 20 14:45:57.878211 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 14:45:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:58.084555 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-82d8a7b8-c580-4dac-8e36-153965f09422 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:58.105086 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-82d8a7b8-c580-4dac-8e36-153965f09422 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.078428 Jun 20 14:45:58.105629 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Jun 20 14:45:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:45:58.926615 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-e1777904-2c1a-42b9-b5f3-1f3e6d5a280d admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:58.928202 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-e1777904-2c1a-42b9-b5f3-1f3e6d5a280d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002261 Jun 20 14:45:58.928914 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 14:45:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:45:59.123278 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-61afcc9e-0d52-4fbb-99b7-f1a1396eb517 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:45:59.144801 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-61afcc9e-0d52-4fbb-99b7-f1a1396eb517 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.078510 Jun 20 14:45:59.145273 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Jun 20 14:45:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:45:59.981463 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-e1777904-2c1a-42b9-b5f3-1f3e6d5a280d admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:45:59.982470 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-e1777904-2c1a-42b9-b5f3-1f3e6d5a280d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jun 20 14:45:59.982882 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 14:45:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:46:00.178580 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-aa78ab1b-ee25-4d03-b634-9ed0617b6b76 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:46:00.198326 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-aa78ab1b-ee25-4d03-b634-9ed0617b6b76 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.079947 Jun 20 14:46:00.198843 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Mon Jun 20 14:46:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:46:46.889975 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-e1777904-2c1a-42b9-b5f3-1f3e6d5a280d admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:46:46.891336 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-e1777904-2c1a-42b9-b5f3-1f3e6d5a280d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002021 Jun 20 14:46:46.891847 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 930 bytes} [Mon Jun 20 14:46:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:46:46.903907 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:46:46.953224 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-1e2f5dda-a375-43d4-ab16-4cae9e9ec995 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:46:46.972510 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-1e2f5dda-a375-43d4-ab16-4cae9e9ec995 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073113 Jun 20 14:46:46.973075 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1291 bytes} [Mon Jun 20 14:46:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:46:46.996090 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-a767e898-95ec-4a6e-9a12-0fe1855da7cf admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:46:46.999568 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG dbcounter [-] [109599] Writing DB stats nova_api:SELECT=14 {{(pid=109599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:46:47.005901 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-a767e898-95ec-4a6e-9a12-0fe1855da7cf admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013483 Jun 20 14:46:47.006444 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1282 bytes} [Mon Jun 20 14:46:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:46:47.018363 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-71f8c2b5-b9ee-48e1-a90a-1f3938ef04fb admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:46:47.026527 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-71f8c2b5-b9ee-48e1-a90a-1f3938ef04fb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011902 Jun 20 14:46:47.026782 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1285 bytes} [Mon Jun 20 14:46:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:46:47.038736 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-bcb41cc2-aa09-4687-aacf-5351d5f61a3d admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:46:47.046966 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-bcb41cc2-aa09-4687-aacf-5351d5f61a3d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011873 Jun 20 14:46:47.047480 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1285 bytes} [Mon Jun 20 14:46:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:46:47.058860 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-e29d2d9f-ea7e-4a56-9e3d-9554ef834cf4 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:46:47.067118 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-e29d2d9f-ea7e-4a56-9e3d-9554ef834cf4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011883 Jun 20 14:46:47.067881 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1282 bytes} [Mon Jun 20 14:46:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:50:01.347411 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-bcb41cc2-aa09-4687-aacf-5351d5f61a3d admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:50:01.348426 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-bcb41cc2-aa09-4687-aacf-5351d5f61a3d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 20 14:50:01.348840 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 14:50:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:50:01.489180 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_api:SELECT=6 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:50:01.621022 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-2de3c041-4a29-4294-a55f-35ff20cba722 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:50:01.622188 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:50:01.622188 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: warnings.warn(msg) Jun 20 14:50:01.623854 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-2de3c041-4a29-4294-a55f-35ff20cba722 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:50:01.624292 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-2de3c041-4a29-4294-a55f-35ff20cba722 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:50:01.625099 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-2de3c041-4a29-4294-a55f-35ff20cba722 admin admin] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:50:01.625517 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-2de3c041-4a29-4294-a55f-35ff20cba722 admin admin] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:50:01.664039 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-2de3c041-4a29-4294-a55f-35ff20cba722 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.175684 Jun 20 14:50:01.664962 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Jun 20 14:50:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:50:02.487877 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-bcb41cc2-aa09-4687-aacf-5351d5f61a3d admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:50:02.489124 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-bcb41cc2-aa09-4687-aacf-5351d5f61a3d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001656 Jun 20 14:50:02.489677 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 14:50:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:50:02.682747 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-5d8f98a9-58be-4b78-b84b-b7d6f8d68111 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:50:02.684005 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:50:02.684005 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: warnings.warn(msg) Jun 20 14:50:02.685255 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-5d8f98a9-58be-4b78-b84b-b7d6f8d68111 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:50:02.685716 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-5d8f98a9-58be-4b78-b84b-b7d6f8d68111 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:50:02.686513 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-5d8f98a9-58be-4b78-b84b-b7d6f8d68111 admin admin] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:50:02.686943 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-5d8f98a9-58be-4b78-b84b-b7d6f8d68111 admin admin] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:50:02.706939 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-5d8f98a9-58be-4b78-b84b-b7d6f8d68111 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078966 Jun 20 14:50:02.707477 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Jun 20 14:50:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:50:13.947519 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-bcb41cc2-aa09-4687-aacf-5351d5f61a3d admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:50:13.948496 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-bcb41cc2-aa09-4687-aacf-5351d5f61a3d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 20 14:50:13.948964 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 14:50:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:50:14.090882 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_cell0:SELECT=4 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:50:14.091813 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_cell1:SELECT=4 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:50:14.092804 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG dbcounter [-] [109600] Writing DB stats nova_api:SELECT=8 {{(pid=109600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:50:14.144529 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-6ad43580-09b7-43ea-82a3-9a4671a1e553 admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:50:14.145736 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:50:14.145736 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: warnings.warn(msg) Jun 20 14:50:14.146929 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-6ad43580-09b7-43ea-82a3-9a4671a1e553 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:50:14.147370 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-6ad43580-09b7-43ea-82a3-9a4671a1e553 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:50:14.148146 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-6ad43580-09b7-43ea-82a3-9a4671a1e553 admin admin] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:50:14.148568 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-6ad43580-09b7-43ea-82a3-9a4671a1e553 admin admin] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:50:14.173684 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-6ad43580-09b7-43ea-82a3-9a4671a1e553 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087271 Jun 20 14:50:14.174161 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Jun 20 14:50:14 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:50:14.994194 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: DEBUG nova.api.openstack.wsgi [None req-bcb41cc2-aa09-4687-aacf-5351d5f61a3d admin admin] Calling method '>' {{(pid=109599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:50:14.995217 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: INFO nova.api.openstack.requestlog [None req-bcb41cc2-aa09-4687-aacf-5351d5f61a3d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 20 14:50:14.995611 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: [pid: 109599|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Jun 20 14:50:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:50:15.200465 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG nova.api.openstack.wsgi [None req-fea47ad0-e526-48e9-a7ac-6a039c0166cb admin admin] Calling method '>' {{(pid=109600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:50:15.201846 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:50:15.201846 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: warnings.warn(msg) Jun 20 14:50:15.203687 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-fea47ad0-e526-48e9-a7ac-6a039c0166cb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:50:15.204306 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-fea47ad0-e526-48e9-a7ac-6a039c0166cb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:50:15.205505 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-fea47ad0-e526-48e9-a7ac-6a039c0166cb admin admin] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:50:15.206093 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: DEBUG oslo_concurrency.lockutils [None req-fea47ad0-e526-48e9-a7ac-6a039c0166cb admin admin] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:50:15.231083 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: INFO nova.api.openstack.requestlog [None req-fea47ad0-e526-48e9-a7ac-6a039c0166cb admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.098068 Jun 20 14:50:15.231629 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: [pid: 109600|app: 0|req: 39/76] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Jun 20 14:50:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:51:14.533363 dv-cinder-836973-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 20 14:51:14.533921 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: Mon Jun 20 14:51:14 2022 - graceful shutdown triggered... Jun 20 14:51:14.534352 dv-cinder-836973-5-iscsi devstack@n-api.service[109599]: Gracefully killing worker 1 (pid: 109599)... Jun 20 14:51:14.534706 dv-cinder-836973-5-iscsi devstack@n-api.service[109600]: Gracefully killing worker 2 (pid: 109600)... Jun 20 14:51:15.535005 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: worker 1 buried after 1 seconds Jun 20 14:51:15.535005 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: worker 2 buried after 1 seconds Jun 20 14:51:15.535005 dv-cinder-836973-5-iscsi devstack@n-api.service[109598]: goodbye to uWSGI. Jun 20 14:51:15.537541 dv-cinder-836973-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 20 14:51:15.538449 dv-cinder-836973-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 20 14:51:15.542980 dv-cinder-836973-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 14:51:15.560142 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 14:51:15.562344 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 14:51:15 2022] *** Jun 20 14:51:15.562344 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 14:51:15.562344 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 14:51:15.562344 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: nodename: dv-cinder-836973-5-iscsi Jun 20 14:51:15.562344 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: machine: x86_64 Jun 20 14:51:15.562344 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: clock source: unix Jun 20 14:51:15.562344 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: pcre jit disabled Jun 20 14:51:15.562344 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: detected number of CPU cores: 4 Jun 20 14:51:15.562344 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: current working directory: / Jun 20 14:51:15.562344 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: detected binary path: /usr/bin/uwsgi-core Jun 20 14:51:15.562344 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: your processes number limit is 47680 Jun 20 14:51:15.562344 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: your memory page size is 4096 bytes Jun 20 14:51:15.562344 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: detected max file descriptor number: 2048 Jun 20 14:51:15.562344 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: lock engine: pthread robust mutexes Jun 20 14:51:15.563359 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: thunder lock: enabled Jun 20 14:51:15.563359 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 14:51:15.563359 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 14:51:15.610991 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: Python main interpreter initialized at 0x559ca1f5b9c0 Jun 20 14:51:15.610991 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: python threads support enabled Jun 20 14:51:15.610991 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: your server socket listen backlog is limited to 100 connections Jun 20 14:51:15.610991 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: your mercy for graceful operations on workers is 90 seconds Jun 20 14:51:15.611446 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 14:51:15.611446 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: *** Operational MODE: preforking *** Jun 20 14:51:15.611745 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: *** uWSGI is running in multiple interpreter mode *** Jun 20 14:51:15.611745 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: spawned uWSGI master process (pid: 123955) Jun 20 14:51:15.612023 dv-cinder-836973-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 14:51:15.612706 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: spawned uWSGI worker 1 (pid: 123978, cores: 1) Jun 20 14:51:15.613421 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: spawned uWSGI worker 2 (pid: 123979, cores: 1) Jun 20 14:51:15.613765 dv-cinder-836973-5-iscsi devstack@n-api.service[123955]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 14:51:16.265091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 14:51:16.273464 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 14:51:17.455829 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 14:51:17.455829 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: from cryptography.utils import int_from_bytes Jun 20 14:51:17.456494 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 14:51:17.456494 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: from cryptography.utils import int_from_bytes Jun 20 14:51:17.510626 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 14:51:17.510626 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: from cryptography.utils import int_from_bytes Jun 20 14:51:17.511222 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 14:51:17.511222 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: from cryptography.utils import int_from_bytes Jun 20 14:51:19.850783 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 14:51:19.851402 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 14:51:19.851928 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 14:51:19.852291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 14:51:19.852543 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 14:51:19.853543 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.853543 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.854220 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.854220 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.854797 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.854797 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.855227 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.855514 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.856020 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.856396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.856697 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.857074 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-5-iscsi {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.857397 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.857705 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.858017 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.858336 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.858639 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.858960 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.859265 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.859769 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.861332 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.861332 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.861332 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.861332 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.862050 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.862050 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.862050 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.862576 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.862784 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.862973 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.863298 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-5-iscsi {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.863612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.863926 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.864237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.864683 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.865019 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.865291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.865639 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.865942 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.866249 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.866576 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.866893 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.867233 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.867523 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.867823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.868126 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.868465 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.868926 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.869150 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.869451 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.869706 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.869994 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.870314 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.870632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.870953 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.871224 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.871475 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.871762 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.872079 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.872383 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.872687 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.873015 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.873397 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.873622 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.873959 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.874220 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.875161 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.875161 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.875161 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.875555 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.875794 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.876064 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.876459 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.876706 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.877033 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.877369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.877688 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.877995 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.878309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.878627 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.878934 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.879238 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.879549 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.879865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.880203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.880505 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.880773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.881075 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.881378 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.881694 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.881997 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.882302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.882609 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.882907 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.883211 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.883518 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.883820 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.884203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.884522 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.884849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.885157 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.885462 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.885763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.886077 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.886397 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.886703 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.887008 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.887383 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.887609 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.888083 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.888391 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.889214 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.889214 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.889489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.889625 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.889926 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.890280 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.890530 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.890845 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.891143 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.891444 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.891759 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.892361 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.892361 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.892654 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.892984 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.893288 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.893615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.893888 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.894204 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.894484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.894801 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.895122 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.895429 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.895735 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.896033 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.896351 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.896687 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.897040 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.897384 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.897698 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.898027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.898359 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.898678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.898989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.899303 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.899635 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.899987 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.900520 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.901006 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.901335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.901659 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.901992 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.902311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.902634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.902949 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.903264 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.903566 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.903885 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.904220 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.904536 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.904911 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.905259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.905573 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.905877 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.906216 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.906533 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.906841 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.907148 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.907472 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.907805 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.908114 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.908429 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.908740 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.909079 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.909394 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.909702 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.909998 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.910337 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.910651 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.910968 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.911280 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.911597 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.911907 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.912217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.912524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.912854 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.913160 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.913462 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.913769 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.914075 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.914395 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.914798 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.915027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.915422 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.915783 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.916161 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.916435 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.916772 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.917083 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.917396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.917706 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.918012 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.918337 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.918643 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.918949 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.919276 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.919581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.919886 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.920206 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.920517 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.920855 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.921170 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.921481 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.921808 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.922124 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.922438 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.922776 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.923110 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.923880 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.923880 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.924274 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.924411 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.924734 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.924971 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.925276 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.925582 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.925883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.926274 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.926491 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.926795 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.927098 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.927400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.927701 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.928025 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.928331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.928632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.928961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.929269 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.929615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.929922 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.930264 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.930599 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.930919 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.931486 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.931885 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.932316 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.932633 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.932975 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.933290 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.933601 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.933962 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.934345 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.934550 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.934868 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.935193 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.935504 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.935824 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.936129 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.936464 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.936804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.937140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.937457 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.937780 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.938090 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.938442 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.938853 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.939327 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.939647 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.939957 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.940274 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.940584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.940928 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.941239 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.941562 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.941871 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.942190 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.942495 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.942807 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.943137 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.943468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.943778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.944088 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.944489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.944762 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.945045 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.945355 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.945660 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.945966 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.946274 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.946755 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.947020 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.947353 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.947646 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.947957 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.948265 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.948571 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.948903 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.949217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.949548 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.949858 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.950179 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.950499 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.950800 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.951105 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.951427 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.951736 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.952038 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.952343 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.952646 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.953027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.953340 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.953646 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.953964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.954285 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.954630 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.954909 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.955221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.955528 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.955852 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.956165 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.956476 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.957010 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.957165 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.957413 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.957722 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.958047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.958356 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.958667 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.958978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.959286 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.959594 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.959912 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.960502 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.960862 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.961180 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.961497 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.961817 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.962135 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.962501 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.962832 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.963329 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.963645 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.963958 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.964267 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.964573 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.964914 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.965329 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.965522 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.965826 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.966136 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.966440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.966745 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.967047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.967352 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.967669 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.967973 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.968283 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.968586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.968941 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.969251 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.969560 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.969862 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.970163 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.970506 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.970809 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.971149 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.971477 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.971820 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.972122 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.972425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.972767 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.973074 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.973377 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.973681 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.973989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.974297 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.974600 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.974991 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.975210 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.975521 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.975826 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.976126 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.976432 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.976752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.977072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.977579 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.977726 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.978053 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.978627 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.978934 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.979234 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.979549 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.979862 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.980168 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.980472 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.980799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.981105 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.981414 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.981722 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.982025 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.982352 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.982663 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.982967 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.983269 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.983576 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.983878 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.984179 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.984486 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.984830 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.985153 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.985455 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.985765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.986070 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.986376 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.986681 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.986994 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.987301 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.987609 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.987908 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.988212 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.988516 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.988866 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.989181 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.989485 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.989796 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.990100 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.990448 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.990752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.991111 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.991417 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.991733 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.992051 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.992365 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.992675 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.993012 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.993315 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.993717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.994017 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.994324 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.994630 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.994933 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.995254 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.995564 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.995872 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.996191 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.996513 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.996859 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.997151 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 14:51:19.997632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.997868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 14:51:19.998078 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.998078 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.998351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 14:51:19.998480 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.998619 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 14:51:19.998756 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.998891 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 14:51:19.999030 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.999164 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.999290 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.999423 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.999556 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.999691 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:19.999824 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:19.999824 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.000071 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.000206 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.000339 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.000465 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.000604 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.000767 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.000908 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.001045 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.001172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.001310 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.001436 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.001612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.001745 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.001920 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.002053 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.002223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.002364 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-5-iscsi {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.002531 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.002664 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.002833 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.002979 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.003122 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.003247 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.003432 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.003562 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.003734 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.003874 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.004059 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.004192 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.004363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.004510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.004781 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.004983 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.005143 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.005779 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.005910 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.006022 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.006139 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.006261 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.006379 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.006498 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.006616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.006726 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.006949 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.007069 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.007186 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.007296 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.007402 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.007517 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.007634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.007750 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.007886 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.008086 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.008297 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.008430 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-5-iscsi {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.008541 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.008656 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.008806 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.008920 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.009028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.011417 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.011600 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.011600 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.011600 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.011986 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.012134 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.012264 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.012398 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.012528 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.012655 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.012836 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.012985 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.013114 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.013250 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.013377 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.013502 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.013630 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.013765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.013891 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.014020 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.014145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.014270 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.014403 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.014548 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.014696 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.014961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.015111 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.015239 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.015373 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.015509 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.015636 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.015781 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.015981 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.016120 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.016255 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.016382 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.016516 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.016642 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.016823 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.016952 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.017098 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.017233 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.017368 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.017494 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.017629 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.017629 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.017884 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.018011 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.018224 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.018445 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.018575 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.018716 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.018846 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.018980 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.019114 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.019240 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.019908 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.020027 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.020137 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.020253 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.020361 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.020469 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.020585 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.020696 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.020828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.020946 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.021054 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.021161 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.021286 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.021403 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.021512 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.021626 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.021741 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.021857 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.021979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.022094 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.022202 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.022309 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.022424 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.022533 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.022649 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.022784 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.023178 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.023321 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.023456 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.023592 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.023729 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.023863 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.023997 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.024131 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.024131 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.024536 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.024665 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.024891 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.025019 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.025158 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.025292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.025292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.025538 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.025538 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.025782 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.025914 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.025914 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.025914 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.026361 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.026495 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.027147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.027147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.027404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.027530 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.027668 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.027794 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.027918 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.028054 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.028202 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.028396 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.028620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.028776 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.028905 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.029041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.029169 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.029296 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.029430 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.029557 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.029691 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.029831 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.029959 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.030084 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.030218 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.030345 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.030479 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.030606 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.030731 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.030856 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.030991 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.031116 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.031259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.031394 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.031520 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.031666 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.031844 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.031980 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.032121 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.032248 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.032381 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.032509 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.032642 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.032812 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.032949 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.033075 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.033209 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.033345 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.033487 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.033487 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.033733 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.033859 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.034003 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.034710 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.034846 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.034971 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.035105 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.035230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.035365 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.035491 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.035629 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.035755 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.035881 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.036004 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.036154 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.036355 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.036486 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.036612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.036754 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.036880 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.037022 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.037149 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.037322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.037468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.037595 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.037819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.037948 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.037948 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.038187 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.038319 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.038555 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.038791 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.038922 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.039055 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.039183 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.039307 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.039439 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.039574 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.039700 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.039843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.039969 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.040094 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.040228 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.040364 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.040499 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.040632 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.040773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.040773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.041096 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.041227 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.041362 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.041535 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.041671 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.041873 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.042071 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:51:20.042219 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.042350 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.042476 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.042611 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.042745 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.042964 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.043157 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.043297 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.043439 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.043567 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.043693 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.043925 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.044130 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.044269 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.044412 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.044542 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.044830 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.044969 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.045099 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.045233 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.045359 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.045494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.045629 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.045764 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.045891 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.046099 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.046293 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.046529 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.046681 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.046812 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.046939 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.047073 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.047209 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.047348 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.047475 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.047600 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.047726 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.047940 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.048133 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.048287 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.048420 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.048563 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.048809 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.049035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.049184 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.049324 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.049459 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.049594 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.049720 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.049846 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.049989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.050119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.050254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.050452 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.050648 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.050795 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.050933 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.051069 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.051196 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.051335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.051472 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.051645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.051784 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.051958 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.052088 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.052267 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.052398 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.052582 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.052783 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.052913 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.053051 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.053227 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.053423 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.053568 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.053737 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.053865 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.054069 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.054207 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.054398 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.054543 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.054721 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.054854 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.055040 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.055177 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.055352 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.055491 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.055675 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.055806 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.056037 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.056178 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.056349 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.056667 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.056884 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.057102 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.057253 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.057380 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.057522 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.057659 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.057806 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.057944 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.058112 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.058242 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.058419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.058549 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.058724 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.058932 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.059075 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.059311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.059460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.059638 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.059775 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.059967 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.060095 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.060272 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.060408 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.060603 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.060783 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.060936 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.061076 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.061253 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.061391 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.061567 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.061704 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.061870 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.061999 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.062175 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.062310 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.062485 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.062614 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.062796 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.062925 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.063101 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.063228 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.063403 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.063531 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.063716 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.063860 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.064335 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.064466 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.064644 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.064790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.064984 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.065125 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.065287 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.065422 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.065607 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.065735 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.065910 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.066060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.066215 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.066354 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.066521 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.066664 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.066856 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.066995 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.067124 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.067259 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.067409 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.068865 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.068980 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.069060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.069141 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.069214 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.069292 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.069363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.069447 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.069526 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.069603 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.069674 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.069743 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.069812 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.069895 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.069966 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.070035 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.070105 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.070194 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.070273 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.070414 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.070525 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.070741 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.070853 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.071046 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.071172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.071349 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.071440 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.071724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.071815 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.072115 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.072442 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.072541 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.072779 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.072896 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.073109 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.073198 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.073407 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.073497 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.073735 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.073833 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.074050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.074272 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.074459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.074613 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.074784 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.074934 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.075090 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.075244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.075385 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.075566 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.075720 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.075868 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.076026 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.076178 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.076469 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.076687 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.076901 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.077112 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.077270 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.077422 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.077564 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.077704 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.077845 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.077984 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.078134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.078306 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.078467 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.078616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.078762 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.078911 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.079061 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.079216 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.079356 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.079494 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.079642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.079793 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.079965 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.080222 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.080369 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.080517 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.080657 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.080835 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.080990 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.081131 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.081276 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.081415 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.081554 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.081701 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.081849 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.081988 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.082148 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.082294 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.082440 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.082594 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.082735 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.082875 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.083021 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.083160 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.083332 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.083486 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.083636 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.083775 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.083925 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.084064 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.084210 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.084363 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.084512 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.084659 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.084857 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.084997 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.085148 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.085295 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.085441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.085441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.085714 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.085864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.086018 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.086168 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.086317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.086457 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.086603 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.086751 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.086899 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.087041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.087312 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.087467 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.087617 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.087617 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.087910 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.088049 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.088188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.088357 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.088513 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.088659 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.088839 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.089017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.089164 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.089344 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.089538 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.089681 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.089830 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.089969 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.090109 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.090276 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.090500 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.090652 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.090792 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.090941 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.091088 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.091243 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.091384 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.091522 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.091668 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.091817 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.091965 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.092117 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.092258 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.092397 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.092535 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.092682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.092867 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.093024 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.093173 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.093321 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.093461 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.093599 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.093754 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.093895 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.094034 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.094180 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.094320 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.094467 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.094620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.094768 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.094915 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.095055 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.095194 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.095340 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.095586 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.095736 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.095878 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.096018 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.096166 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.096313 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.096463 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.096610 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.096767 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.096911 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.097062 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.097212 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.097442 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.097600 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.097749 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.097897 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.098037 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.098189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.098331 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.098470 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.098618 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.098765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.098904 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.099069 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.099301 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.099459 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.099612 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.099751 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.099890 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.100038 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.100178 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.100317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.100462 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.100708 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.100886 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.101028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.101176 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.101325 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.101464 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.101613 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.101763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.101903 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.102042 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.102188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.102328 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.102466 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.102619 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.102761 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.102934 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.103074 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.103221 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.103369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.103524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.103707 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.103855 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.104002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.104148 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.104326 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.104480 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.104645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.104841 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.104991 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.105252 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.105406 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.105587 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.105733 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.105897 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.106051 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.106211 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.106371 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.106513 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.106659 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.106810 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.106951 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.107106 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.107246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.107417 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.107635 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.107788 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.107930 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.108090 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.108245 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.108422 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.108565 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.108751 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.108901 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.109043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.109191 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.109338 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.109499 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.109648 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.109795 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.109941 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.110081 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.110219 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.110376 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.110526 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.110689 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.110922 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.111068 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.111209 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.111371 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.111519 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.111658 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 14:51:20.111799 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.111937 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.112222 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.112535 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.112867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.113193 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.113503 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.113809 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.114113 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.114417 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.114759 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.115063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.115406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.116759 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.116759 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.116759 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.116759 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.117738 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.117738 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.117738 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.117982 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.118172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.118582 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.119177 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.119543 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.119930 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.120201 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.120519 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.120878 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.121164 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.121504 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.121822 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.122107 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.122431 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.122736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.123047 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.123353 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.123662 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.123975 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.124275 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.124598 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.124923 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.125243 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.125542 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.125853 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.126165 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.126468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.126793 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.127104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.127408 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.127698 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.128012 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.128316 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.128620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.128953 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.129280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.129601 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.129909 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.130218 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.130526 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.130834 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.131142 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.131458 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.131767 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.132081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.132387 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.132697 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.133028 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.133360 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.133674 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.133982 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.134921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.135226 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.135582 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.135921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.136327 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.136693 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.137039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.137365 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.137684 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.138001 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.138316 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.138631 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.138941 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.139253 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.139569 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.139876 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.140181 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.140504 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.140844 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.141160 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.141484 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.142189 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.142516 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.142824 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.143138 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.143452 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.143760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.144072 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.144385 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.144696 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.145033 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.145354 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.145669 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.145980 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.146292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.146603 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.146912 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.147217 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.147542 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.147853 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.148161 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.148468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.148803 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.149118 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.149423 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.150396 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.150728 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.151049 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.151360 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.151677 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.151992 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.152316 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.152631 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.152968 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.153391 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.153706 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.154021 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.154337 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.155030 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.155030 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.155339 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.155564 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.155969 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.156317 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.156678 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.157206 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.157572 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.157904 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.158332 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.158650 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.158960 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.159382 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.159699 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.160014 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.160346 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.160671 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.161023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.161335 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.161653 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.161965 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.162292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.162620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.162932 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.163251 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.163558 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.163885 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.164210 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.164527 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.164878 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.165309 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.166120 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.166451 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.166788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.167126 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.167444 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.167757 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.168075 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.168388 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.168698 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.169050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.169361 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.169677 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.169995 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.170308 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.170618 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.170928 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.171255 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.171563 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.171987 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.172209 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.172534 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.172885 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.173235 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.173560 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.173871 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.174182 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.174459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.174766 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.175115 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.175425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.175757 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.176126 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.176455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.176778 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.177134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.177452 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.177770 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.178092 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.178418 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.178727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.179029 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.179320 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO dbcounter [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] Registered counter for database nova_api Jun 20 14:51:20.179432 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.179636 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.179945 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.180256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.180567 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.180981 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.181497 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.182184 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.182520 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.182834 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.183164 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.183482 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.183791 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.184100 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.184410 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.184783 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.185096 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.185432 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.185758 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.186090 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.186420 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.186734 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.187060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.187381 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.187699 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.188017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.188332 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.188650 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.188997 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.189629 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.189941 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.190256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.190572 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.190891 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.191456 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.191793 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.192112 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.192431 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.192789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.193126 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.193454 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.193758 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.194073 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.194389 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.194665 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.195331 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.195331 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.195947 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.195947 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.196292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.196650 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.197532 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.197863 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.198230 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.198552 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.198867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.199185 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.199513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.199833 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.200151 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.200469 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.200813 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.201023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_db.sqlalchemy.engines [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123979) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:51:20.201186 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.201441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.201755 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.202074 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.202395 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.202725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.203063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.203390 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.203728 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.204035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.204354 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.204939 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.205249 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.205585 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.205918 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.206247 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.206571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.206895 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.207223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.207535 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.207820 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writer thread running {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:51:20.207964 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.208147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.208460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.208789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.209116 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.209429 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.209737 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.210057 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.210369 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.210922 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.211287 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.211603 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.211950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.212329 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.213250 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.213572 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.213903 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.214215 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.214527 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.214850 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.215169 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.215477 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.215786 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.216757 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.216757 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.216757 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.217403 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.217732 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.218069 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.218393 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.218702 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.219016 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.219332 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.219643 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.219950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.220257 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.220564 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.220902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.221213 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.221530 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.221839 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.222152 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.222461 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.222773 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.223130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.223458 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.223772 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.224078 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.224407 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.224737 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.225067 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.225386 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.225837 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.226045 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.226369 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.226925 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.227261 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.227582 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.227944 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.228843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.229167 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.229483 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.229795 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.230124 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.230443 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.230761 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.231075 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.231391 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.231707 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.232021 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.232334 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.232646 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.232986 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.233301 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.233611 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.233924 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.234234 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.234551 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.234893 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.235214 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.235536 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.235853 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.236171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.236488 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.236823 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.237135 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.237449 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.237781 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.238546 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.238546 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.238919 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.239258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.239572 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.239911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.240208 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.240517 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.240863 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.241190 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.241502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.241831 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.242144 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.242474 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.242816 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.243148 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.243581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.244495 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.247268 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.247627 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.247944 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.248419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.248621 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.248980 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.249312 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.249633 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.250031 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.250281 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.250567 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.250879 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.251195 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.251503 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.251810 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.252117 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.252423 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.252745 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.253058 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.253371 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.253684 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.253991 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.254296 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.254602 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.254905 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.255245 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.255586 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.255905 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.256230 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.256546 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.256895 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.257228 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.257529 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.257852 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.258174 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.258490 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.258829 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.259220 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.260149 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.260397 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.260729 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.261571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.261571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.261840 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.261983 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.262285 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.262617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.262940 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.263265 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.263587 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.263902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.264236 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.264551 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.264889 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.265210 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.265300 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.context [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),316254da-3fa1-408c-aacc-695744828597(cell1) {{(pid=123979) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 14:51:20.265523 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.265839 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.266158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.266475 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.266804 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.267134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.267447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.267771 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.268105 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.268458 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.268876 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.269243 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.269567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:51:20.269715 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.269878 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.270888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.270888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:51:20.270888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 14:51:20.271315 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:51:20.272006 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:51:20.275738 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:51:20.276864 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO dbcounter [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] Registered counter for database nova_cell0 Jun 20 14:51:20.281351 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO dbcounter [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] Registered counter for database nova_cell1 Jun 20 14:51:20.289199 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_db.sqlalchemy.engines [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123979) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:51:20.291509 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_db.sqlalchemy.engines [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123979) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:51:20.299166 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writer thread running {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:51:20.299501 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writer thread running {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:51:20.335543 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO dbcounter [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] Registered counter for database nova_api Jun 20 14:51:20.357057 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_db.sqlalchemy.engines [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123978) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:51:20.364194 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writer thread running {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:51:20.423216 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.context [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),316254da-3fa1-408c-aacc-695744828597(cell1) {{(pid=123978) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 14:51:20.427395 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:51:20.429041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:51:20.429853 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:51:20.432525 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:51:20.434614 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO dbcounter [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] Registered counter for database nova_cell0 Jun 20 14:51:20.439939 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO dbcounter [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] Registered counter for database nova_cell1 Jun 20 14:51:20.447545 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO dbcounter [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] Registered counter for database nova_cell0 Jun 20 14:51:20.449403 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_db.sqlalchemy.engines [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123978) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:51:20.450654 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_db.sqlalchemy.engines [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123978) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:51:20.454451 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_db.sqlalchemy.engines [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123979) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:51:20.457036 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writer thread running {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:51:20.459087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writer thread running {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:51:20.459679 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writer thread running {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:51:20.611903 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO dbcounter [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] Registered counter for database nova_cell0 Jun 20 14:51:20.618844 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_db.sqlalchemy.engines [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123978) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:51:20.624317 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writer thread running {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:51:20.773864 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: WARNING keystonemiddleware.auth_token [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 14:51:20.781336 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: WARNING keystonemiddleware.auth_token [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 14:51:20.952454 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: WARNING keystonemiddleware.auth_token [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 14:51:20.960040 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: WARNING keystonemiddleware.auth_token [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 14:51:21.116867 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: WARNING keystonemiddleware.auth_token [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 14:51:21.123060 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: WARNING keystonemiddleware.auth_token [None req-688c0771-58a0-47ec-95ac-6a37590907ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 14:51:21.128524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559ca1f5b9c0 pid: 123979 (default app) Jun 20 14:51:21.316030 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: WARNING keystonemiddleware.auth_token [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 14:51:21.322616 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: WARNING keystonemiddleware.auth_token [None req-dc166155-a367-4534-9794-d8fff58d0f85 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 14:51:21.328029 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559ca1f5b9c0 pid: 123978 (default app) Jun 20 14:51:59.870912 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=3 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:51:59.874347 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=3 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:51:59.877827 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=3 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:51:59.879300 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=3 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:01.013208 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6ac6029f-be3f-404f-bc39-801a5d04b807 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Action: 'create', calling method: .version_select at 0x7fce52a26700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-793999180"}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:01.034970 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=3 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:01.036307 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=3 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:01.037056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=3 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:01.038752 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=3 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:02.640487 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-727a069d-04ce-4b5c-b12e-82f34404dfd5 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] Action: 'create', calling method: .version_select at 0x7fce52a2a700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2032759359", "metadata": {"Type": "work"}}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:03.376507 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6ac6029f-be3f-404f-bc39-801a5d04b807 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.521009 Jun 20 14:52:03.377452 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1154 bytes} [Mon Jun 20 14:51:59 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3525 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 14:52:03.402797 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0f9745e9-d9b4-4728-83e2-0408bbe26087 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce528ef550>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:03.645641 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0f9745e9-d9b4-4728-83e2-0408bbe26087 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842" status: 200 len: 344 microversion: 2.1 time: 0.255124 Jun 20 14:52:03.649191 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 2/2] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:52:03 2022] GET /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842 => generated 344 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:04.363860 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-727a069d-04ce-4b5c-b12e-82f34404dfd5 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.335002 Jun 20 14:52:04.366392 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1155 bytes} [Mon Jun 20 14:52:01 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3339 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 14:52:04.379069 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e0e96051-9e2d-4ab8-afd7-8fddd6359ab8 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] Calling method '.version_select at 0x7fce528ef8b0>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:04.488655 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e0e96051-9e2d-4ab8-afd7-8fddd6359ab8 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04" status: 200 len: 353 microversion: 2.1 time: 0.114892 Jun 20 14:52:04.491020 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 3/4] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:52:04 2022] GET /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:04.664017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d77f80dc-a2b3-49c5-a87c-96408bbfd86d tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce528f0550>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:04.733954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d77f80dc-a2b3-49c5-a87c-96408bbfd86d tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842" status: 200 len: 345 microversion: 2.1 time: 0.077912 Jun 20 14:52:04.734971 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 2/5] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:52:04 2022] GET /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842 => generated 345 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:04.746844 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ce65f6b1-2378-4757-a3b6-9a79b9f84c49 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Action: 'create', calling method: .version_select at 0x7fce528efca0>, body: {"snapshot": {"volume_id": "61756363-7acb-49a7-83b7-cc96d4834842", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1020867153"}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:05.302051 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ce65f6b1-2378-4757-a3b6-9a79b9f84c49 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.560093 Jun 20 14:52:05.302750 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 4/6] 10.222.0.23 () {60 vars in 1161 bytes} [Mon Jun 20 14:52:04 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:05.313654 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e4134197-ec43-4f13-92c1-4cf1f7514b0e tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce528f05e0>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:05.501844 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3e660980-99dc-4fa8-b7f5-4ca3a6542676 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] Calling method '.version_select at 0x7fce52900940>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:05.877085 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e4134197-ec43-4f13-92c1-4cf1f7514b0e tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51" status: 200 len: 287 microversion: 2.1 time: 0.567217 Jun 20 14:52:05.877990 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 3/7] 10.222.0.23 () {58 vars in 1250 bytes} [Mon Jun 20 14:52:05 2022] GET /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51 => generated 287 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:05.889755 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-70b8844f-f805-448b-ae10-375b353744eb tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce528f0d30>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:05.954092 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3e660980-99dc-4fa8-b7f5-4ca3a6542676 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04" status: 200 len: 354 microversion: 2.1 time: 0.456191 Jun 20 14:52:05.955063 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 5/8] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:52:05 2022] GET /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 => generated 354 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:05.975234 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-796efa07-d652-45c1-97ea-c8fdcd9c3df0 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] Calling method '.version_select at 0x7fce528efe50>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:06.000997 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-70b8844f-f805-448b-ae10-375b353744eb tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.115257 Jun 20 14:52:06.019615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 4/9] 10.222.0.23 () {58 vars in 1139 bytes} [Mon Jun 20 14:52:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:06.031249 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c95e39ba-fe2a-4bee-8d84-75128be69af3 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce5288aa60>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:06.089868 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-796efa07-d652-45c1-97ea-c8fdcd9c3df0 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04" status: 200 len: 354 microversion: 2.1 time: 0.118555 Jun 20 14:52:06.091452 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 6/10] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:52:05 2022] GET /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 14:52:06.108300 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9755ef55-bdf9-4866-8d30-b2952d116ee7 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] Calling method '.version_select at 0x7fce528ef8b0>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:06.182567 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-c95e39ba-fe2a-4bee-8d84-75128be69af3 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51" status: 200 len: 287 microversion: 2.1 time: 0.115312 Jun 20 14:52:06.182567 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 5/11] 10.222.0.23 () {58 vars in 1250 bytes} [Mon Jun 20 14:52:06 2022] GET /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51 => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:06.221387 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9755ef55-bdf9-4866-8d30-b2952d116ee7 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04" status: 202 len: 0 microversion: 2.1 time: 0.117632 Jun 20 14:52:06.222102 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 7/12] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 14:52:06 2022] DELETE /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 14:52:06.230953 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f7a3a819-96d1-4376-9525-b94316fbe2af tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] Calling method '.version_select at 0x7fce528f0ca0>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:06.310576 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f7a3a819-96d1-4376-9525-b94316fbe2af tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04" status: 200 len: 353 microversion: 2.1 time: 0.082748 Jun 20 14:52:06.311393 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 6/13] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:52:06 2022] GET /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 14:52:07.156021 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6a15accd-7d84-4965-a226-58695ab61ae2 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce529008b0>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:07.255890 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6a15accd-7d84-4965-a226-58695ab61ae2 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51" status: 200 len: 287 microversion: 2.1 time: 0.104391 Jun 20 14:52:07.255890 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 8/14] 10.222.0.23 () {58 vars in 1250 bytes} [Mon Jun 20 14:52:07 2022] GET /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:07.336561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b4a1ac05-9938-4f54-82b3-5308cf1c27dd tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] Calling method '.version_select at 0x7fce528f0790>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:07.446908 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b4a1ac05-9938-4f54-82b3-5308cf1c27dd tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04" status: 200 len: 353 microversion: 2.1 time: 0.126536 Jun 20 14:52:07.447951 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 7/15] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:52:07 2022] GET /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:08.265956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-dbec767c-0a31-49e6-84d2-693539fb1b31 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce528ef8b0>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:08.390201 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-dbec767c-0a31-49e6-84d2-693539fb1b31 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51" status: 200 len: 287 microversion: 2.1 time: 0.131567 Jun 20 14:52:08.394951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 9/16] 10.222.0.23 () {58 vars in 1250 bytes} [Mon Jun 20 14:52:08 2022] GET /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51 => generated 287 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:08.464766 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6b2887ab-9b7d-4b97-aedd-280d4f0f1e57 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] Calling method '.version_select at 0x7fce5288a940>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:08.629749 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6b2887ab-9b7d-4b97-aedd-280d4f0f1e57 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04" status: 200 len: 353 microversion: 2.1 time: 0.173708 Jun 20 14:52:08.630401 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 8/17] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:52:08 2022] GET /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 => generated 353 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:09.402241 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2313aa78-9b13-4cc7-a24c-4e2b67b22e77 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce528efe50>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:09.450065 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-2313aa78-9b13-4cc7-a24c-4e2b67b22e77 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51" status: 200 len: 288 microversion: 2.1 time: 0.051752 Jun 20 14:52:09.450970 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 10/18] 10.222.0.23 () {58 vars in 1250 bytes} [Mon Jun 20 14:52:09 2022] GET /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51 => generated 288 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:09.461169 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d32b0907-9f4f-4fab-ba51-290847e9926b tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce528f05e0>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:09.586363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d32b0907-9f4f-4fab-ba51-290847e9926b tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51" status: 202 len: 0 microversion: 2.1 time: 0.128934 Jun 20 14:52:09.587721 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 9/19] 10.222.0.23 () {58 vars in 1253 bytes} [Mon Jun 20 14:52:09 2022] DELETE /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 14:52:09.600119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-bccb8310-ef90-48b8-ba9a-b0b63457c667 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce52900790>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:09.645270 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b67848bb-345a-4ca5-9b13-f7f59d528298 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] Calling method '.version_select at 0x7fce528f0dc0>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:09.677946 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-bccb8310-ef90-48b8-ba9a-b0b63457c667 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51" status: 200 len: 287 microversion: 2.1 time: 0.085193 Jun 20 14:52:09.678538 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 11/20] 10.222.0.23 () {58 vars in 1250 bytes} [Mon Jun 20 14:52:09 2022] GET /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:09.726613 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-b67848bb-345a-4ca5-9b13-f7f59d528298 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] HTTP exception thrown: Volume b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 could not be found. Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b67848bb-345a-4ca5-9b13-f7f59d528298 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] Request method failure captured: Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 HTTP/1.1 Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImQohEw172fkx-lunInb14dgijqftFFecp0oRtlVzdrQVI_xds0-db8hOgoWamGDPAMi7EjSDbD1ppUVA7ISYWmMnaC9SSHRBNuyfoUpa746tBt8rVwa6jZIH9PZ6rFk--UZtFeaSCcuX5a_KnK87_J1tEvs6rEPpGXmu98ETiO4BE Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: d707620ca5d640f78d1a8d5cf64358e2 Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-VolumesGetTestJSON-1465221550 Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:52:09.733425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:52:09.734682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d707620ca5d640f78d1a8d5cf64358e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d707620ca5d640f78d1a8d5cf64358e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d707620ca5d640f78d1a8d5cf64358e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d707620ca5d640f78d1a8d5cf64358e2"}]}] Jun 20 14:52:09.734682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-VolumesGetTestJSON-1465221550 Jun 20 14:52:09.734682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: d707620ca5d640f78d1a8d5cf64358e2 Jun 20 14:52:09.734682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-VolumesGetTestJSON-1465221550 Jun 20 14:52:09.734682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-VolumesGetTestJSON-1465221550-project Jun 20 14:52:09.734682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:52:09.734682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:52:09.734682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 7026acdb52b844acbe60b4974e5a4ffc Jun 20 14:52:09.734682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-VolumesGetTestJSON-1465221550-project Jun 20 14:52:09.734682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: Jun 20 14:52:09.734682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Volume b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 could not be found. Jun 20 14:52:09.734682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': 'b69d8e9c-6fd4-4096-aaa5-b5575db8ca04'} Jun 20 14:52:09.734682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 could not be found. (HTTP 404) (Request-ID: req-fd4001b9-a1af-4532-ac66-dd66001a9b7a) Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:09.735286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 14:52:09.736363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 could not be found. Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 14:52:09.737256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:52:09.738130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 could not be found. Jun 20 14:52:09.738130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:09.738130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:09.738130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:09.738130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:09.738130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:09.738130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:09.738130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:52:09.738130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:52:09.738130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 could not be found. Jun 20 14:52:09.738130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:09.738130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b67848bb-345a-4ca5-9b13-f7f59d528298 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] Returning 404 to user: Volume b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:52:09.738130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b67848bb-345a-4ca5-9b13-f7f59d528298 tempest-VolumesGetTestJSON-1465221550 tempest-VolumesGetTestJSON-1465221550-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04" status: 404 len: 109 microversion: 2.1 time: 0.096647 Jun 20 14:52:09.743274 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 10/21] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:52:09 2022] GET /compute/v2.1/os-volumes/b69d8e9c-6fd4-4096-aaa5-b5575db8ca04 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:52:10.691982 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-913dad6c-f26f-4b05-918a-6c6924ab43ec tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce529001f0>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:10.751559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-913dad6c-f26f-4b05-918a-6c6924ab43ec tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] HTTP exception thrown: Snapshot 8eb2c368-8a6b-4164-8b0a-991668643f51 could not be found. Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-913dad6c-f26f-4b05-918a-6c6924ab43ec tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Request method failure captured: Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51 HTTP/1.1 Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImPcuT8_5btKalgWTnFqSmTLYHJKSTrZqgrR-N2S142zPlKfTvM-9nsvZoLwmuOuGBDdDrudeSIzy9mwWNYoujh7VBeO8d3_2IkOfetzTp-EP_LHyWrs-LEHv-DOGl2jBk3sw74nm2OOpxTG9_8HYXJ5OlhWKIvfEzhsrZOddkYyoU Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: bd09d185eb7f41999e0373a3d701d5e4 Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1907053606 Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:52:10.756146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:52:10.757404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd09d185eb7f41999e0373a3d701d5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd09d185eb7f41999e0373a3d701d5e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd09d185eb7f41999e0373a3d701d5e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd09d185eb7f41999e0373a3d701d5e4"}]}] Jun 20 14:52:10.757404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1907053606 Jun 20 14:52:10.757404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: bd09d185eb7f41999e0373a3d701d5e4 Jun 20 14:52:10.757404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1907053606 Jun 20 14:52:10.757404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-VolumesSnapshotsTestJSON-1907053606-project Jun 20 14:52:10.757404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:52:10.757404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:52:10.757404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 95d9ab41801744e78c956b2a9fddd773 Jun 20 14:52:10.757404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1907053606-project Jun 20 14:52:10.757404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: Jun 20 14:52:10.757404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Snapshot 8eb2c368-8a6b-4164-8b0a-991668643f51 could not be found. Jun 20 14:52:10.757404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '8eb2c368-8a6b-4164-8b0a-991668643f51'} Jun 20 14:52:10.757404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8eb2c368-8a6b-4164-8b0a-991668643f51 could not be found. (HTTP 404) (Request-ID: req-0231ffef-27de-4295-92e6-185391ee28f9) Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:10.758416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 14:52:10.759245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8eb2c368-8a6b-4164-8b0a-991668643f51 could not be found. Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 20 14:52:10.760094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:52:10.761440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8eb2c368-8a6b-4164-8b0a-991668643f51 could not be found. Jun 20 14:52:10.761440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:10.761440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:10.761440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:10.761440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:10.761440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:10.761440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:10.761440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:52:10.761440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:52:10.761440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8eb2c368-8a6b-4164-8b0a-991668643f51 could not be found. Jun 20 14:52:10.761440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:10.761440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-913dad6c-f26f-4b05-918a-6c6924ab43ec tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Returning 404 to user: Snapshot 8eb2c368-8a6b-4164-8b0a-991668643f51 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:52:10.761440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-913dad6c-f26f-4b05-918a-6c6924ab43ec tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51" status: 404 len: 111 microversion: 2.1 time: 0.071905 Jun 20 14:52:10.762864 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 12/22] 10.222.0.23 () {58 vars in 1250 bytes} [Mon Jun 20 14:52:10 2022] GET /compute/v2.1/os-snapshots/8eb2c368-8a6b-4164-8b0a-991668643f51 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 14:52:10.768271 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d619b32a-36a7-4702-b761-3a683362bf65 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce5288ae50>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:10.890185 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d619b32a-36a7-4702-b761-3a683362bf65 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842" status: 202 len: 0 microversion: 2.1 time: 0.125982 Jun 20 14:52:10.893461 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 14:52:10 2022] DELETE /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 14:52:10.901844 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1451afc0-d4b7-482c-8287-6090ccbef5b2 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce529004c0>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:11.029322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1451afc0-d4b7-482c-8287-6090ccbef5b2 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842" status: 200 len: 344 microversion: 2.1 time: 0.132215 Jun 20 14:52:11.029890 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 13/24] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:52:10 2022] GET /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:11.839912 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-5dbc85fa-e6f7-4b7a-b099-6c6b694a151b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Action: 'create', calling method: .version_select at 0x7fce528761f0>, body: {"keypair": {"name": "tempest-keypair-694137795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIk7RA+gzZEwJA0QOTuqqTvcI/Pf8YkIwiFg+mRSpdMLmnKZ9QzspFnuryYbqlDxj0iXqfi898eyMHgH9tDoUIwpOryoXIB5ksRU6uzdKBwf8TXv4xYUfiYwsznFPDkGzA=="}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:11.950059 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-5dbc85fa-e6f7-4b7a-b099-6c6b694a151b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'key_pairs'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:52:11.957770 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-5dbc85fa-e6f7-4b7a-b099-6c6b694a151b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for user 87c3f39c0bed4fadbc8a556c857baf4a and project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'key_pairs'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:52:12.043525 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2fcda97f-e461-4ad8-9a40-d4d4041c4fef tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce52900790>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:12.102967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-5dbc85fa-e6f7-4b7a-b099-6c6b694a151b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.517330 Jun 20 14:52:12.103916 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 12/25] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 14:52:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:12.135297 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-2fcda97f-e461-4ad8-9a40-d4d4041c4fef tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842" status: 200 len: 344 microversion: 2.1 time: 0.097129 Jun 20 14:52:12.135861 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 14/26] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:52:12 2022] GET /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842 => generated 344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:13.152170 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9da50b10-513f-4980-bd20-73b37d97be8e tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce52888040>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:13.200998 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1422464258", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:13.269087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-9da50b10-513f-4980-bd20-73b37d97be8e tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] HTTP exception thrown: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9da50b10-513f-4980-bd20-73b37d97be8e tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Request method failure captured: Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842 HTTP/1.1 Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImPcuT8_5btKalgWTnFqSmTLYHJKSTrZqgrR-N2S142zPlKfTvM-9nsvZoLwmuOuGBDdDrudeSIzy9mwWNYoujh7VBeO8d3_2IkOfetzTp-EP_LHyWrs-LEHv-DOGl2jBk3sw74nm2OOpxTG9_8HYXJ5OlhWKIvfEzhsrZOddkYyoU Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: bd09d185eb7f41999e0373a3d701d5e4 Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1907053606 Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:52:13.271331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:52:13.272586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd09d185eb7f41999e0373a3d701d5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd09d185eb7f41999e0373a3d701d5e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd09d185eb7f41999e0373a3d701d5e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd09d185eb7f41999e0373a3d701d5e4"}]}] Jun 20 14:52:13.272586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1907053606 Jun 20 14:52:13.272586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: bd09d185eb7f41999e0373a3d701d5e4 Jun 20 14:52:13.272586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1907053606 Jun 20 14:52:13.272586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-VolumesSnapshotsTestJSON-1907053606-project Jun 20 14:52:13.272586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:52:13.272586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:52:13.272586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 95d9ab41801744e78c956b2a9fddd773 Jun 20 14:52:13.272586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1907053606-project Jun 20 14:52:13.272586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: Jun 20 14:52:13.272586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. Jun 20 14:52:13.272586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '61756363-7acb-49a7-83b7-cc96d4834842'} Jun 20 14:52:13.272586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. (HTTP 404) (Request-ID: req-99408e8a-da06-46b7-8d5f-2b2d5a112011) Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:13.273388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 14:52:13.274335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 14:52:13.275339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:52:13.276217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. Jun 20 14:52:13.276217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.276217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:13.276217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.276217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:13.276217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:13.276217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:13.276217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:52:13.276217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:52:13.276217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. Jun 20 14:52:13.276217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.276217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9da50b10-513f-4980-bd20-73b37d97be8e tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Returning 404 to user: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:52:13.276217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9da50b10-513f-4980-bd20-73b37d97be8e tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842" status: 404 len: 109 microversion: 2.1 time: 0.126382 Jun 20 14:52:13.279166 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 15/27] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:52:13 2022] GET /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842 => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:52:13.290466 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6c4394ce-53e9-4d41-a39d-0810d469675c tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce53252c10>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:13.456817 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-6c4394ce-53e9-4d41-a39d-0810d469675c tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] HTTP exception thrown: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6c4394ce-53e9-4d41-a39d-0810d469675c tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Request method failure captured: Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: DELETE /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842 HTTP/1.1 Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImPcuT8_5btKalgWTnFqSmTLYHJKSTrZqgrR-N2S142zPlKfTvM-9nsvZoLwmuOuGBDdDrudeSIzy9mwWNYoujh7VBeO8d3_2IkOfetzTp-EP_LHyWrs-LEHv-DOGl2jBk3sw74nm2OOpxTG9_8HYXJ5OlhWKIvfEzhsrZOddkYyoU Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: bd09d185eb7f41999e0373a3d701d5e4 Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1907053606 Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:52:13.458979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:52:13.460203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd09d185eb7f41999e0373a3d701d5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd09d185eb7f41999e0373a3d701d5e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd09d185eb7f41999e0373a3d701d5e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd09d185eb7f41999e0373a3d701d5e4"}]}] Jun 20 14:52:13.460203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1907053606 Jun 20 14:52:13.460203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: bd09d185eb7f41999e0373a3d701d5e4 Jun 20 14:52:13.460203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1907053606 Jun 20 14:52:13.460203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-VolumesSnapshotsTestJSON-1907053606-project Jun 20 14:52:13.460203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:52:13.460203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:52:13.460203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 95d9ab41801744e78c956b2a9fddd773 Jun 20 14:52:13.460203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1907053606-project Jun 20 14:52:13.460203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: Jun 20 14:52:13.460203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. Jun 20 14:52:13.460203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '61756363-7acb-49a7-83b7-cc96d4834842'} Jun 20 14:52:13.460203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. (HTTP 404) (Request-ID: req-e45e4f57-a158-45a6-9b87-8cdd90fb8046) Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:13.461259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 14:52:13.462927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 14:52:13.464091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:52:13.465087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. Jun 20 14:52:13.465087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.465087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:13.465087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.465087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:13.465087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:13.465087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:13.465087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:52:13.465087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:52:13.465087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. Jun 20 14:52:13.465087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.465087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6c4394ce-53e9-4d41-a39d-0810d469675c tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Returning 404 to user: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:52:13.466078 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6c4394ce-53e9-4d41-a39d-0810d469675c tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842" status: 404 len: 109 microversion: 2.1 time: 0.179256 Jun 20 14:52:13.466730 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 16/28] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 14:52:13 2022] DELETE /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842 => generated 109 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:52:13.476888 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b614db4c-9f47-49c9-82dc-746fb2f283f2 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Calling method '.version_select at 0x7fce528884c0>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:13.533599 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.network.neutron [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] validate_networks() for [('7525c8ce-ba0d-41dc-84d9-0e995f7e941d', None, None, None, None, None)] {{(pid=123978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:52:13.554297 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-b614db4c-9f47-49c9-82dc-746fb2f283f2 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] HTTP exception thrown: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b614db4c-9f47-49c9-82dc-746fb2f283f2 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Request method failure captured: Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842 HTTP/1.1 Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImPcuT8_5btKalgWTnFqSmTLYHJKSTrZqgrR-N2S142zPlKfTvM-9nsvZoLwmuOuGBDdDrudeSIzy9mwWNYoujh7VBeO8d3_2IkOfetzTp-EP_LHyWrs-LEHv-DOGl2jBk3sw74nm2OOpxTG9_8HYXJ5OlhWKIvfEzhsrZOddkYyoU Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: bd09d185eb7f41999e0373a3d701d5e4 Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1907053606 Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:52:13.556892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:52:13.557938 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd09d185eb7f41999e0373a3d701d5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd09d185eb7f41999e0373a3d701d5e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd09d185eb7f41999e0373a3d701d5e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd09d185eb7f41999e0373a3d701d5e4"}]}] Jun 20 14:52:13.557938 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1907053606 Jun 20 14:52:13.557938 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: bd09d185eb7f41999e0373a3d701d5e4 Jun 20 14:52:13.557938 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1907053606 Jun 20 14:52:13.557938 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-VolumesSnapshotsTestJSON-1907053606-project Jun 20 14:52:13.557938 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:52:13.557938 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:52:13.557938 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 95d9ab41801744e78c956b2a9fddd773 Jun 20 14:52:13.557938 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1907053606-project Jun 20 14:52:13.557938 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: Jun 20 14:52:13.557938 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. Jun 20 14:52:13.557938 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '61756363-7acb-49a7-83b7-cc96d4834842'} Jun 20 14:52:13.557938 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. (HTTP 404) (Request-ID: req-5417d9d9-0fdf-4dd3-8208-076daf31f446) Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:13.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 14:52:13.559458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 14:52:13.560425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:52:13.561400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. Jun 20 14:52:13.561400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.561400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:13.561400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.561400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:13.561400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:13.561400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:13.561400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:52:13.561400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:52:13.561400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. Jun 20 14:52:13.561400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:13.573151 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b614db4c-9f47-49c9-82dc-746fb2f283f2 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] Returning 404 to user: Volume 61756363-7acb-49a7-83b7-cc96d4834842 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:52:13.574121 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-b614db4c-9f47-49c9-82dc-746fb2f283f2 tempest-VolumesSnapshotsTestJSON-1907053606 tempest-VolumesSnapshotsTestJSON-1907053606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842" status: 404 len: 109 microversion: 2.1 time: 0.102947 Jun 20 14:52:13.578890 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 17/29] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:52:13 2022] GET /compute/v2.1/os-volumes/61756363-7acb-49a7-83b7-cc96d4834842 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 14:52:16.971870 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-661892894", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2b22871-0b88-408a-81b6-567b6c78e97d"}], "security_groups": [{"name": "tempest-securitygroup--86096303"}], "key_name": "tempest-keypair-694137795", "user_data": "}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:17.367010 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.network.neutron [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] validate_networks() for [('b2b22871-0b88-408a-81b6-567b6c78e97d', None, None, None, None, None)] {{(pid=123979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:52:18.901370 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Flavor limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:52:18.901988 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Image limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:52:18.902670 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Flavor pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:52:18.902670 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Image pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:52:18.903036 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:52:18.930700 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:18.931171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:18.931980 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:18.932384 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:19.019875 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Getting quotas for project 1333ac4890624e11941a2681b51b07ab. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:52:19.038296 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Getting quotas for user afc8379be09748a68ade6af9b99cdfa2 and project 1333ac4890624e11941a2681b51b07ab. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:52:19.051468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Going to run 1 instances... {{(pid=123978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:52:19.054690 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:52:19.220891 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-4b3f87db-ca19-4afd-a82b-03e60f519abd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.305936 Jun 20 14:52:19.227084 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 13/30] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 14:52:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 6318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 14:52:19.234753 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6f235d50-0e3e-47a8-8ddf-91bebbfb925c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:19.235397 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6f235d50-0e3e-47a8-8ddf-91bebbfb925c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:19.529160 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-6f235d50-0e3e-47a8-8ddf-91bebbfb925c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:19.575450 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6f235d50-0e3e-47a8-8ddf-91bebbfb925c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1222 microversion: 2.1 time: 0.344904 Jun 20 14:52:19.577159 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 14/31] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:19 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1222 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:19.884798 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Flavor limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:52:19.886025 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Image limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:52:19.886568 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Flavor pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:52:19.886998 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Image pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:52:19.887450 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:52:19.906637 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:19.907209 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:19.907995 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:19.908463 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:19.969840 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:52:19.990603 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for user 87c3f39c0bed4fadbc8a556c857baf4a and project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:52:20.053357 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Going to run 1 instances... {{(pid=123979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:52:20.064504 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:52:20.311031 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e829082a-a426-4fc4-b3ff-680cdd0437e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.344767 Jun 20 14:52:20.319179 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 18/32] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 14:52:16 2022] POST /compute/v2.1/servers => generated 400 bytes in 3354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 14:52:20.327723 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3043295f-049c-46c6-8f1b-9145cdea0275 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:20.330261 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3043295f-049c-46c6-8f1b-9145cdea0275 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:20.589791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3043295f-049c-46c6-8f1b-9145cdea0275 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:20.620383 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3043295f-049c-46c6-8f1b-9145cdea0275 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1240 microversion: 2.1 time: 0.299628 Jun 20 14:52:20.639018 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 19/33] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:20 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1240 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:20.747667 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1738717767", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:20.867264 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.network.neutron [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] validate_networks() for [('7525c8ce-ba0d-41dc-84d9-0e995f7e941d', None, None, None, None, None)] {{(pid=123979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:52:21.045090 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-122428390", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "networks": [{"uuid": "1d11d7fa-1bd8-4968-b0fd-ff1f9411ca73"}]}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:21.147470 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.network.neutron [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] validate_networks() for [('1d11d7fa-1bd8-4968-b0fd-ff1f9411ca73', None, None, None, None, None)] {{(pid=123978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:52:22.105994 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Flavor limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:52:22.107383 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Image limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:52:22.107720 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Flavor pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:52:22.108687 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Image pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:52:22.109473 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:52:22.128293 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:22.128692 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:22.135747 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:22.139555 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:22.209786 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Getting quotas for project 1333ac4890624e11941a2681b51b07ab. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:52:22.224073 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Getting quotas for user afc8379be09748a68ade6af9b99cdfa2 and project 1333ac4890624e11941a2681b51b07ab. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:52:22.263315 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Going to run 1 instances... {{(pid=123979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:52:22.271483 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:52:22.386105 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-f76707f5-f7ff-4c05-8056-9897ec74a5f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.643057 Jun 20 14:52:22.394096 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 20/34] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 14:52:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 14:52:22.431651 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d2bacf11-a109-4774-9104-3be489ef1f11 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:22.434708 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d2bacf11-a109-4774-9104-3be489ef1f11 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:22.491420 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d2bacf11-a109-4774-9104-3be489ef1f11 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:22.494525 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d2bacf11-a109-4774-9104-3be489ef1f11 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:22.499803 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d2bacf11-a109-4774-9104-3be489ef1f11 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:22.503383 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d2bacf11-a109-4774-9104-3be489ef1f11 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:22.869325 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Flavor limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:52:22.870452 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Image limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:52:22.871155 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Flavor pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:52:22.871684 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Image pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:52:22.872326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:52:22.889342 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:22.890009 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:22.891474 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:22.893179 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:22.934757 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Getting quotas for project 361bd83b835c4ec3b01a1173b2d9cb1d. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:52:22.946242 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Getting quotas for user 75ebe0d05a1c4b66aa3b3abebd0ce026 and project 361bd83b835c4ec3b01a1173b2d9cb1d. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:52:22.989216 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Going to run 1 instances... {{(pid=123978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:52:22.994188 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:52:23.048105 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d2bacf11-a109-4774-9104-3be489ef1f11 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:23.087925 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d2bacf11-a109-4774-9104-3be489ef1f11 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1244 microversion: 2.1 time: 0.687783 Jun 20 14:52:23.090417 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 21/35] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:22 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1244 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:23.109363 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0c962370-4fec-404f-addc-39d56708ac1d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:23.113459 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-0c962370-4fec-404f-addc-39d56708ac1d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:23.194298 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-95edd526-4b3d-465e-b248-8e6c69a842de tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.501266 Jun 20 14:52:23.198632 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 15/36] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 14:52:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 14:52:23.365943 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0c962370-4fec-404f-addc-39d56708ac1d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:23.377139 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0c962370-4fec-404f-addc-39d56708ac1d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1222 microversion: 2.1 time: 0.283844 Jun 20 14:52:23.378821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 22/37] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:23 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1222 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:23.412495 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8efc7f00-860e-421f-bd02-28ef5f2478ed tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:23.414445 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-8efc7f00-860e-421f-bd02-28ef5f2478ed tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:23.574018 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8efc7f00-860e-421f-bd02-28ef5f2478ed tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:23.584515 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-8efc7f00-860e-421f-bd02-28ef5f2478ed tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1214 microversion: 2.1 time: 0.203343 Jun 20 14:52:23.587379 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 23/38] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:23 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:23.822327 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-44d9a8ba-f32c-44a6-9b49-102e245f2dc1 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Action: 'create', calling method: .version_select at 0x7fce50ec7a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1847751969", "metadata": {"Type": "work"}}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-44d9a8ba-f32c-44a6-9b49-102e245f2dc1 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Request method failure captured: Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 122 Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImmSwcSlGk1xgOsDeQhLwcCNZ3unwysBtSTETkQDIJB68ulBNa5f9_azB0_PUZ3eLm4e5gqXGOyFOgU5ALTYL_K44f6gqSjBDkXnK0QwrMUeL5neSIkyk3C_e6Qb3nU_3Z4X7iOlXsVt1Vuudd_mSeCmxXYOnbqByXizU8JtgZ0LD4 Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: dcad324a672a462e951dcdce5b62dc5b Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:52:23.842056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:52:23.843341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dcad324a672a462e951dcdce5b62dc5b"}]}] Jun 20 14:52:23.843341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:23.843341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: dcad324a672a462e951dcdce5b62dc5b Jun 20 14:52:23.843341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:23.843341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-VolumesNegativeTest-1638612-project Jun 20 14:52:23.843341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:52:23.843341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:52:23.843341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 545933a87e6a4993afaa6528b86e327e Jun 20 14:52:23.843341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-VolumesNegativeTest-1638612-project Jun 20 14:52:23.843341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Jun 20 14:52:23.843341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1847751969", "metadata": {"Type": "work"}}} Jun 20 14:52:23.843341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: Jun 20 14:52:23.843341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1847751969', 'metadata': {'Type': 'work'}}}} Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise error Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi '#$%' Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:52:23.844035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 14:52:23.845137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 14:52:23.846221 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 14:52:23.846221 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.847719 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-44d9a8ba-f32c-44a6-9b49-102e245f2dc1 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:52:23.848969 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-44d9a8ba-f32c-44a6-9b49-102e245f2dc1 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.648962 Jun 20 14:52:23.853051 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 16/39] 10.222.0.23 () {60 vars in 1155 bytes} [Mon Jun 20 14:52:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 653 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 14:52:23.861561 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8a82ba30-fa7f-401b-9081-75d9e5a7a57a tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Action: 'create', calling method: .version_select at 0x7fce516b6940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1590927809", "metadata": {"Type": "work"}}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8a82ba30-fa7f-401b-9081-75d9e5a7a57a tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Request method failure captured: Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 120 Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImmSwcSlGk1xgOsDeQhLwcCNZ3unwysBtSTETkQDIJB68ulBNa5f9_azB0_PUZ3eLm4e5gqXGOyFOgU5ALTYL_K44f6gqSjBDkXnK0QwrMUeL5neSIkyk3C_e6Qb3nU_3Z4X7iOlXsVt1Vuudd_mSeCmxXYOnbqByXizU8JtgZ0LD4 Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: dcad324a672a462e951dcdce5b62dc5b Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:52:23.865951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:52:23.867593 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dcad324a672a462e951dcdce5b62dc5b"}]}] Jun 20 14:52:23.867593 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:23.867593 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: dcad324a672a462e951dcdce5b62dc5b Jun 20 14:52:23.867593 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:23.867593 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-VolumesNegativeTest-1638612-project Jun 20 14:52:23.867593 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:52:23.867593 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:52:23.867593 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 545933a87e6a4993afaa6528b86e327e Jun 20 14:52:23.867593 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-VolumesNegativeTest-1638612-project Jun 20 14:52:23.867593 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Jun 20 14:52:23.867593 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1590927809", "metadata": {"Type": "work"}}} Jun 20 14:52:23.867593 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: Jun 20 14:52:23.867593 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1590927809', 'metadata': {'Type': 'work'}}}} Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise error Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi '0' Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:52:23.868446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 14:52:23.869632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 14:52:23.870574 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 14:52:23.870574 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.870574 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8a82ba30-fa7f-401b-9081-75d9e5a7a57a tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:52:23.871739 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-8a82ba30-fa7f-401b-9081-75d9e5a7a57a tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012281 Jun 20 14:52:23.885150 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 24/40] 10.222.0.23 () {60 vars in 1155 bytes} [Mon Jun 20 14:52:23 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 14:52:23.894766 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-217da9b1-38c5-4680-8117-e2aade62aa56 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Action: 'create', calling method: .version_select at 0x7fce51f2bc10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1563254553", "metadata": {"Type": "work"}}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-217da9b1-38c5-4680-8117-e2aade62aa56 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Request method failure captured: Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 119 Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImmSwcSlGk1xgOsDeQhLwcCNZ3unwysBtSTETkQDIJB68ulBNa5f9_azB0_PUZ3eLm4e5gqXGOyFOgU5ALTYL_K44f6gqSjBDkXnK0QwrMUeL5neSIkyk3C_e6Qb3nU_3Z4X7iOlXsVt1Vuudd_mSeCmxXYOnbqByXizU8JtgZ0LD4 Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: dcad324a672a462e951dcdce5b62dc5b Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:52:23.904262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:52:23.905657 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dcad324a672a462e951dcdce5b62dc5b"}]}] Jun 20 14:52:23.905657 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:23.905657 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: dcad324a672a462e951dcdce5b62dc5b Jun 20 14:52:23.905657 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:23.905657 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-VolumesNegativeTest-1638612-project Jun 20 14:52:23.905657 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:52:23.905657 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:52:23.905657 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 545933a87e6a4993afaa6528b86e327e Jun 20 14:52:23.905657 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-VolumesNegativeTest-1638612-project Jun 20 14:52:23.905657 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Jun 20 14:52:23.905657 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1563254553", "metadata": {"Type": "work"}}} Jun 20 14:52:23.905657 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: Jun 20 14:52:23.905657 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1563254553', 'metadata': {'Type': 'work'}}}} Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise error Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi '' Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:52:23.906682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 14:52:23.908540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 14:52:23.909781 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 14:52:23.909781 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:23.912488 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-217da9b1-38c5-4680-8117-e2aade62aa56 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:52:23.933332 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-217da9b1-38c5-4680-8117-e2aade62aa56 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.034780 Jun 20 14:52:23.938342 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 17/41] 10.222.0.23 () {60 vars in 1155 bytes} [Mon Jun 20 14:52:23 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 14:52:23.944980 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-758e55ef-3940-4344-a8d8-a5cf7e7ef675 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Calling method '.version_select at 0x7fce517338b0>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:24.019554 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-758e55ef-3940-4344-a8d8-a5cf7e7ef675 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] HTTP exception thrown: Volume tempest-invalid-2011378401 could not be found. Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-758e55ef-3940-4344-a8d8-a5cf7e7ef675 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Request method failure captured: Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2011378401 HTTP/1.1 Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImmSwcSlGk1xgOsDeQhLwcCNZ3unwysBtSTETkQDIJB68ulBNa5f9_azB0_PUZ3eLm4e5gqXGOyFOgU5ALTYL_K44f6gqSjBDkXnK0QwrMUeL5neSIkyk3C_e6Qb3nU_3Z4X7iOlXsVt1Vuudd_mSeCmxXYOnbqByXizU8JtgZ0LD4 Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: dcad324a672a462e951dcdce5b62dc5b Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:52:24.026615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:52:24.027749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dcad324a672a462e951dcdce5b62dc5b"}]}] Jun 20 14:52:24.027749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:24.027749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: dcad324a672a462e951dcdce5b62dc5b Jun 20 14:52:24.027749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:24.027749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-VolumesNegativeTest-1638612-project Jun 20 14:52:24.027749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:52:24.027749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:52:24.027749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 545933a87e6a4993afaa6528b86e327e Jun 20 14:52:24.027749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-VolumesNegativeTest-1638612-project Jun 20 14:52:24.027749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: Jun 20 14:52:24.027749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Volume tempest-invalid-2011378401 could not be found. Jun 20 14:52:24.027749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': 'tempest-invalid-2011378401'} Jun 20 14:52:24.027749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:52:24.027749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2011378401 could not be found. (HTTP 404) (Request-ID: req-c14671e6-2e5e-40fe-9c85-e6a8a426c6ad) Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.029152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 14:52:24.030524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2011378401 could not be found. Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:52:24.031421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2011378401 could not be found. Jun 20 14:52:24.032374 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.032374 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:24.032374 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.032374 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:24.032374 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:24.032374 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:24.032374 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:52:24.032374 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:52:24.032374 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2011378401 could not be found. Jun 20 14:52:24.032374 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.037464 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-758e55ef-3940-4344-a8d8-a5cf7e7ef675 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Returning 404 to user: Volume tempest-invalid-2011378401 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:52:24.038575 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-758e55ef-3940-4344-a8d8-a5cf7e7ef675 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2011378401" status: 404 len: 99 microversion: 2.1 time: 0.098460 Jun 20 14:52:24.041400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 25/42] 10.222.0.23 () {58 vars in 1217 bytes} [Mon Jun 20 14:52:23 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2011378401 => generated 99 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 14:52:24.050915 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-78dc1c39-4961-4a40-905a-ce3cc42f3a3c tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003946 Jun 20 14:52:24.052687 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 18/43] 10.222.0.23 () {58 vars in 1139 bytes} [Mon Jun 20 14:52:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 14:52:24.061959 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-49a49ca3-8746-453a-b6bf-bbd8438e92fe tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004054 Jun 20 14:52:24.065515 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 26/44] 10.222.0.23 () {58 vars in 1136 bytes} [Mon Jun 20 14:52:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 14:52:24.075613 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-bd70088d-eea5-489b-9498-a5374db25232 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Calling method '.version_select at 0x7fce50ed09d0>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:24.107366 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1d6199d8-8909-4b34-8037-d93d9cbfcbd7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:24.108226 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-1d6199d8-8909-4b34-8037-d93d9cbfcbd7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:24.121676 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1d6199d8-8909-4b34-8037-d93d9cbfcbd7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:24.123040 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1d6199d8-8909-4b34-8037-d93d9cbfcbd7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:24.124600 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1d6199d8-8909-4b34-8037-d93d9cbfcbd7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:24.125245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1d6199d8-8909-4b34-8037-d93d9cbfcbd7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:24.206575 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-bd70088d-eea5-489b-9498-a5374db25232 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] HTTP exception thrown: Volume f03f0d6d-7f1b-485e-8f37-d720d1a743ba could not be found. Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-bd70088d-eea5-489b-9498-a5374db25232 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Request method failure captured: Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: DELETE /compute/v2.1/os-volumes/f03f0d6d-7f1b-485e-8f37-d720d1a743ba HTTP/1.1 Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImmSwcSlGk1xgOsDeQhLwcCNZ3unwysBtSTETkQDIJB68ulBNa5f9_azB0_PUZ3eLm4e5gqXGOyFOgU5ALTYL_K44f6gqSjBDkXnK0QwrMUeL5neSIkyk3C_e6Qb3nU_3Z4X7iOlXsVt1Vuudd_mSeCmxXYOnbqByXizU8JtgZ0LD4 Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: dcad324a672a462e951dcdce5b62dc5b Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:52:24.210134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:52:24.211868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dcad324a672a462e951dcdce5b62dc5b"}]}] Jun 20 14:52:24.211868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:24.211868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: dcad324a672a462e951dcdce5b62dc5b Jun 20 14:52:24.211868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:24.211868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-VolumesNegativeTest-1638612-project Jun 20 14:52:24.211868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:52:24.211868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:52:24.211868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 545933a87e6a4993afaa6528b86e327e Jun 20 14:52:24.211868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-VolumesNegativeTest-1638612-project Jun 20 14:52:24.211868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: Jun 20 14:52:24.211868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Volume f03f0d6d-7f1b-485e-8f37-d720d1a743ba could not be found. Jun 20 14:52:24.211868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': 'f03f0d6d-7f1b-485e-8f37-d720d1a743ba'} Jun 20 14:52:24.211868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f03f0d6d-7f1b-485e-8f37-d720d1a743ba could not be found. (HTTP 404) (Request-ID: req-ee0b68f3-ad47-4cbd-9683-a4ba358b343e) Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:24.212544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 14:52:24.213637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f03f0d6d-7f1b-485e-8f37-d720d1a743ba could not be found. Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 14:52:24.214581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:52:24.215571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f03f0d6d-7f1b-485e-8f37-d720d1a743ba could not be found. Jun 20 14:52:24.215571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.215571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:24.215571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.215571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:24.215571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:24.215571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:24.215571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:52:24.215571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:52:24.215571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f03f0d6d-7f1b-485e-8f37-d720d1a743ba could not be found. Jun 20 14:52:24.215571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.218599 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-bd70088d-eea5-489b-9498-a5374db25232 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Returning 404 to user: Volume f03f0d6d-7f1b-485e-8f37-d720d1a743ba could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:52:24.219984 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-bd70088d-eea5-489b-9498-a5374db25232 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/f03f0d6d-7f1b-485e-8f37-d720d1a743ba" status: 404 len: 109 microversion: 2.1 time: 0.148566 Jun 20 14:52:24.221668 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 19/45] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 14:52:24 2022] DELETE /compute/v2.1/os-volumes/f03f0d6d-7f1b-485e-8f37-d720d1a743ba => generated 109 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:52:24.235010 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-5adaeb18-1b9f-4f7f-9308-ff37b9d479a4 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Calling method '.version_select at 0x7fce50ec7dc0>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:24.309997 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-5adaeb18-1b9f-4f7f-9308-ff37b9d479a4 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] HTTP exception thrown: Volume 9feedfb7-2779-4719-8b10-46c82bebce08 could not be found. Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-5adaeb18-1b9f-4f7f-9308-ff37b9d479a4 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Request method failure captured: Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/os-volumes/9feedfb7-2779-4719-8b10-46c82bebce08 HTTP/1.1 Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImmSwcSlGk1xgOsDeQhLwcCNZ3unwysBtSTETkQDIJB68ulBNa5f9_azB0_PUZ3eLm4e5gqXGOyFOgU5ALTYL_K44f6gqSjBDkXnK0QwrMUeL5neSIkyk3C_e6Qb3nU_3Z4X7iOlXsVt1Vuudd_mSeCmxXYOnbqByXizU8JtgZ0LD4 Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: dcad324a672a462e951dcdce5b62dc5b Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:52:24.313145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:52:24.314788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dcad324a672a462e951dcdce5b62dc5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dcad324a672a462e951dcdce5b62dc5b"}]}] Jun 20 14:52:24.314788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:24.314788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: dcad324a672a462e951dcdce5b62dc5b Jun 20 14:52:24.314788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-VolumesNegativeTest-1638612 Jun 20 14:52:24.314788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-VolumesNegativeTest-1638612-project Jun 20 14:52:24.314788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:52:24.314788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:52:24.314788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 545933a87e6a4993afaa6528b86e327e Jun 20 14:52:24.314788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-VolumesNegativeTest-1638612-project Jun 20 14:52:24.314788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: Jun 20 14:52:24.314788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Volume 9feedfb7-2779-4719-8b10-46c82bebce08 could not be found. Jun 20 14:52:24.314788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': '9feedfb7-2779-4719-8b10-46c82bebce08'} Jun 20 14:52:24.314788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9feedfb7-2779-4719-8b10-46c82bebce08 could not be found. (HTTP 404) (Request-ID: req-b1d4200c-715c-4bf1-b504-625cf6c4dd3c) Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:24.315455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 14:52:24.316502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9feedfb7-2779-4719-8b10-46c82bebce08 could not be found. Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 14:52:24.317459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:52:24.318628 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9feedfb7-2779-4719-8b10-46c82bebce08 could not be found. Jun 20 14:52:24.318628 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.318628 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:52:24.318628 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.318628 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:52:24.318628 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:52:24.318628 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:52:24.318628 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:52:24.318628 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:52:24.318628 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9feedfb7-2779-4719-8b10-46c82bebce08 could not be found. Jun 20 14:52:24.318628 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:52:24.322014 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-5adaeb18-1b9f-4f7f-9308-ff37b9d479a4 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] Returning 404 to user: Volume 9feedfb7-2779-4719-8b10-46c82bebce08 could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:52:24.323374 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-5adaeb18-1b9f-4f7f-9308-ff37b9d479a4 tempest-VolumesNegativeTest-1638612 tempest-VolumesNegativeTest-1638612-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/9feedfb7-2779-4719-8b10-46c82bebce08" status: 404 len: 109 microversion: 2.1 time: 0.095771 Jun 20 14:52:24.324806 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 20/46] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:52:24 2022] GET /compute/v2.1/os-volumes/9feedfb7-2779-4719-8b10-46c82bebce08 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 14:52:24.396897 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ced67f8e-6d3a-4ca1-a1af-a0a5db218ebb tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:24.398677 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ced67f8e-6d3a-4ca1-a1af-a0a5db218ebb tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:24.413111 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-1d6199d8-8909-4b34-8037-d93d9cbfcbd7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:24.429950 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1d6199d8-8909-4b34-8037-d93d9cbfcbd7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1300 microversion: 2.1 time: 0.321898 Jun 20 14:52:24.430494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ced67f8e-6d3a-4ca1-a1af-a0a5db218ebb tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:24.442714 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ced67f8e-6d3a-4ca1-a1af-a0a5db218ebb tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:24.443779 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 27/47] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:24 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1300 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:24.445713 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ced67f8e-6d3a-4ca1-a1af-a0a5db218ebb tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:24.451065 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ced67f8e-6d3a-4ca1-a1af-a0a5db218ebb tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:24.604417 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ca49c10c-8e54-475e-8a26-26492670a275 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:24.605282 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ca49c10c-8e54-475e-8a26-26492670a275 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:24.631317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ca49c10c-8e54-475e-8a26-26492670a275 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:24.632035 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ca49c10c-8e54-475e-8a26-26492670a275 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:24.633216 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ca49c10c-8e54-475e-8a26-26492670a275 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:24.633852 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ca49c10c-8e54-475e-8a26-26492670a275 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:24.836085 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ca49c10c-8e54-475e-8a26-26492670a275 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:24.844419 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ca49c10c-8e54-475e-8a26-26492670a275 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1218 microversion: 2.1 time: 0.246513 Jun 20 14:52:24.857167 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 28/48] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:24 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1218 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:52:24.889614 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ced67f8e-6d3a-4ca1-a1af-a0a5db218ebb tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:24.907534 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ced67f8e-6d3a-4ca1-a1af-a0a5db218ebb tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1274 microversion: 2.1 time: 0.515096 Jun 20 14:52:24.909223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 21/49] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:24 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1274 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:25.456634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-a24d40c2-1641-48c5-9cce-7b5e772f8826 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:25.458301 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-a24d40c2-1641-48c5-9cce-7b5e772f8826 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:25.473598 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a24d40c2-1641-48c5-9cce-7b5e772f8826 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:25.474794 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a24d40c2-1641-48c5-9cce-7b5e772f8826 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:25.477616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a24d40c2-1641-48c5-9cce-7b5e772f8826 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:25.479215 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a24d40c2-1641-48c5-9cce-7b5e772f8826 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:25.676348 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a24d40c2-1641-48c5-9cce-7b5e772f8826 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:25.703679 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-a24d40c2-1641-48c5-9cce-7b5e772f8826 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1298 microversion: 2.1 time: 0.254350 Jun 20 14:52:25.709443 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 29/50] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:25 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1298 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:25.861733 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2fd7ff9f-7cdf-4a41-a469-b65541502723 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:25.862361 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2fd7ff9f-7cdf-4a41-a469-b65541502723 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:25.879949 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2fd7ff9f-7cdf-4a41-a469-b65541502723 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:25.881497 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2fd7ff9f-7cdf-4a41-a469-b65541502723 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:25.887861 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2fd7ff9f-7cdf-4a41-a469-b65541502723 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:25.891919 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2fd7ff9f-7cdf-4a41-a469-b65541502723 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:25.934571 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-efaefe89-b98d-442b-b991-aa7a1402286e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:25.935213 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-efaefe89-b98d-442b-b991-aa7a1402286e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:25.962554 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efaefe89-b98d-442b-b991-aa7a1402286e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:25.963029 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efaefe89-b98d-442b-b991-aa7a1402286e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:25.969651 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efaefe89-b98d-442b-b991-aa7a1402286e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:25.974012 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efaefe89-b98d-442b-b991-aa7a1402286e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:26.379470 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-efaefe89-b98d-442b-b991-aa7a1402286e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:26.394254 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-efaefe89-b98d-442b-b991-aa7a1402286e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1280 microversion: 2.1 time: 0.470313 Jun 20 14:52:26.397427 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 30/51] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:25 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1280 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:26.496668 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2fd7ff9f-7cdf-4a41-a469-b65541502723 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:26.504862 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2fd7ff9f-7cdf-4a41-a469-b65541502723 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1272 microversion: 2.1 time: 0.647723 Jun 20 14:52:26.505437 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 22/52] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:25 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1272 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:26.728480 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b96a5b2a-ff53-44f5-9ebd-de7fba9a0c72 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:26.729821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-b96a5b2a-ff53-44f5-9ebd-de7fba9a0c72 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:26.754222 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b96a5b2a-ff53-44f5-9ebd-de7fba9a0c72 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:26.755052 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b96a5b2a-ff53-44f5-9ebd-de7fba9a0c72 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:26.755999 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b96a5b2a-ff53-44f5-9ebd-de7fba9a0c72 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:26.757075 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b96a5b2a-ff53-44f5-9ebd-de7fba9a0c72 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:27.416124 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-71330ff0-0211-48e4-9160-6e487f68471e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:27.416883 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-71330ff0-0211-48e4-9160-6e487f68471e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:27.454351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-71330ff0-0211-48e4-9160-6e487f68471e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:27.459006 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-71330ff0-0211-48e4-9160-6e487f68471e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:27.461646 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-71330ff0-0211-48e4-9160-6e487f68471e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:27.466909 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-71330ff0-0211-48e4-9160-6e487f68471e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:27.741119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-71330ff0-0211-48e4-9160-6e487f68471e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:27.757211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-71330ff0-0211-48e4-9160-6e487f68471e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1280 microversion: 2.1 time: 0.344472 Jun 20 14:52:27.760602 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 23/53] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:27 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1280 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:52:27.776528 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-62bce2da-a8c7-49c6-a91c-66cc156f3e4b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:27.779862 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-62bce2da-a8c7-49c6-a91c-66cc156f3e4b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:27.805587 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-62bce2da-a8c7-49c6-a91c-66cc156f3e4b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:27.807296 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-62bce2da-a8c7-49c6-a91c-66cc156f3e4b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:27.814611 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-b96a5b2a-ff53-44f5-9ebd-de7fba9a0c72 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:27.827500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-62bce2da-a8c7-49c6-a91c-66cc156f3e4b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:27.829531 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-62bce2da-a8c7-49c6-a91c-66cc156f3e4b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:27.838443 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-b96a5b2a-ff53-44f5-9ebd-de7fba9a0c72 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1298 microversion: 2.1 time: 1.115914 Jun 20 14:52:27.839432 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 31/54] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:26 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1298 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:28.126342 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-62bce2da-a8c7-49c6-a91c-66cc156f3e4b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:28.141590 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-62bce2da-a8c7-49c6-a91c-66cc156f3e4b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1272 microversion: 2.1 time: 0.378819 Jun 20 14:52:28.154347 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 24/55] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:27 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1272 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:28.779124 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ee3a6828-583f-41dd-92df-c7950e625140 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:28.780099 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ee3a6828-583f-41dd-92df-c7950e625140 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:28.801965 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ee3a6828-583f-41dd-92df-c7950e625140 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:28.802578 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ee3a6828-583f-41dd-92df-c7950e625140 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:28.808233 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ee3a6828-583f-41dd-92df-c7950e625140 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:28.808742 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ee3a6828-583f-41dd-92df-c7950e625140 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:28.857551 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-bbbf4760-7b24-484a-8e96-655aa283bedc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:28.859565 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-bbbf4760-7b24-484a-8e96-655aa283bedc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:28.890744 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bbbf4760-7b24-484a-8e96-655aa283bedc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:28.891285 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bbbf4760-7b24-484a-8e96-655aa283bedc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:28.896075 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bbbf4760-7b24-484a-8e96-655aa283bedc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:28.899981 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bbbf4760-7b24-484a-8e96-655aa283bedc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:29.562801 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ee3a6828-583f-41dd-92df-c7950e625140 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:29.576072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ee3a6828-583f-41dd-92df-c7950e625140 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1280 microversion: 2.1 time: 0.801897 Jun 20 14:52:29.586503 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 32/56] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:28 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1280 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:29.596579 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-02eb3d35-9a12-4bd7-8d07-75671525081a tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:29.597465 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-02eb3d35-9a12-4bd7-8d07-75671525081a tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:29.616853 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-02eb3d35-9a12-4bd7-8d07-75671525081a tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:29.617202 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-02eb3d35-9a12-4bd7-8d07-75671525081a tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:29.621399 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-02eb3d35-9a12-4bd7-8d07-75671525081a tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:29.622007 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-02eb3d35-9a12-4bd7-8d07-75671525081a tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:29.899235 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-bbbf4760-7b24-484a-8e96-655aa283bedc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:29.933267 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-bbbf4760-7b24-484a-8e96-655aa283bedc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 1.080062 Jun 20 14:52:29.937809 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 25/57] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:28 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:52:30.398001 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-02eb3d35-9a12-4bd7-8d07-75671525081a tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:30.412632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-02eb3d35-9a12-4bd7-8d07-75671525081a tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.824036 Jun 20 14:52:30.415528 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 33/58] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:29 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:30.594346 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b83b63a7-156e-4189-b00b-cb9ee3187961 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:30.595152 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-b83b63a7-156e-4189-b00b-cb9ee3187961 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:30.611219 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b83b63a7-156e-4189-b00b-cb9ee3187961 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:30.611730 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b83b63a7-156e-4189-b00b-cb9ee3187961 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:30.613682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b83b63a7-156e-4189-b00b-cb9ee3187961 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:30.614118 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b83b63a7-156e-4189-b00b-cb9ee3187961 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:30.957654 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-dea46a47-eef6-4f83-8204-562617a14b83 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:30.958920 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-dea46a47-eef6-4f83-8204-562617a14b83 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:30.978332 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dea46a47-eef6-4f83-8204-562617a14b83 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:30.979279 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dea46a47-eef6-4f83-8204-562617a14b83 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:30.983210 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dea46a47-eef6-4f83-8204-562617a14b83 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:30.984977 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dea46a47-eef6-4f83-8204-562617a14b83 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:31.917211 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-dea46a47-eef6-4f83-8204-562617a14b83 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:31.946654 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-dea46a47-eef6-4f83-8204-562617a14b83 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 0.988819 Jun 20 14:52:31.947983 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 34/59] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:30 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:31.955492 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-516c223e-e0f8-45e4-af48-412a02997ed5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:31.957447 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-516c223e-e0f8-45e4-af48-412a02997ed5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:31.977075 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-516c223e-e0f8-45e4-af48-412a02997ed5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:31.978927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-516c223e-e0f8-45e4-af48-412a02997ed5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:31.982929 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-516c223e-e0f8-45e4-af48-412a02997ed5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:31.984266 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-516c223e-e0f8-45e4-af48-412a02997ed5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:32.178661 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=4 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:32.324227 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-b83b63a7-156e-4189-b00b-cb9ee3187961 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:32.340093 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b83b63a7-156e-4189-b00b-cb9ee3187961 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 1.747975 Jun 20 14:52:32.342431 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 26/60] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:30 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:32.797728 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-516c223e-e0f8-45e4-af48-412a02997ed5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:32.808594 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-516c223e-e0f8-45e4-af48-412a02997ed5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.858111 Jun 20 14:52:32.808594 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 35/61] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:31 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:32.969002 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-db7b08d7-7edc-4a4d-82b0-138dc759fc95 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:32.969936 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-db7b08d7-7edc-4a4d-82b0-138dc759fc95 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:32.972962 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=4 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:32.974673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=18 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:32.999737 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-db7b08d7-7edc-4a4d-82b0-138dc759fc95 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:32.999737 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-db7b08d7-7edc-4a4d-82b0-138dc759fc95 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:32.999737 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-db7b08d7-7edc-4a4d-82b0-138dc759fc95 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:32.999737 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-db7b08d7-7edc-4a4d-82b0-138dc759fc95 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:33.360508 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-165e53d8-82ff-417b-a9a7-5d288d5984dd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:33.363678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-165e53d8-82ff-417b-a9a7-5d288d5984dd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:33.388013 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-165e53d8-82ff-417b-a9a7-5d288d5984dd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:33.390907 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-165e53d8-82ff-417b-a9a7-5d288d5984dd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:33.394424 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-165e53d8-82ff-417b-a9a7-5d288d5984dd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:33.395503 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-165e53d8-82ff-417b-a9a7-5d288d5984dd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:33.580327 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=18 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:34.251333 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-db7b08d7-7edc-4a4d-82b0-138dc759fc95 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:34.270673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-db7b08d7-7edc-4a4d-82b0-138dc759fc95 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 1.307334 Jun 20 14:52:34.271941 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 27/62] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:32 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:34.285804 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0b195cfa-9035-471a-9e83-6f2d3ebba407 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:34.287082 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-0b195cfa-9035-471a-9e83-6f2d3ebba407 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:34.310405 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0b195cfa-9035-471a-9e83-6f2d3ebba407 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:34.311464 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0b195cfa-9035-471a-9e83-6f2d3ebba407 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:34.314533 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0b195cfa-9035-471a-9e83-6f2d3ebba407 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:34.315418 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0b195cfa-9035-471a-9e83-6f2d3ebba407 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:35.097935 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-165e53d8-82ff-417b-a9a7-5d288d5984dd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:35.129286 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-165e53d8-82ff-417b-a9a7-5d288d5984dd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 1.770574 Jun 20 14:52:35.145917 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 36/63] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:33 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:52:35.349624 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0b195cfa-9035-471a-9e83-6f2d3ebba407 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:35.395888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0b195cfa-9035-471a-9e83-6f2d3ebba407 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 1.118904 Jun 20 14:52:35.402998 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 28/64] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:34 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:35.408147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-28bf6e2a-2326-4ca6-856d-681c5e5a33c3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:35.418150 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-28bf6e2a-2326-4ca6-856d-681c5e5a33c3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:35.452199 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-28bf6e2a-2326-4ca6-856d-681c5e5a33c3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:35.457455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-28bf6e2a-2326-4ca6-856d-681c5e5a33c3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:35.460617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-28bf6e2a-2326-4ca6-856d-681c5e5a33c3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:35.462188 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-28bf6e2a-2326-4ca6-856d-681c5e5a33c3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:35.761080 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-96afa6fc-44c8-463a-836a-7ff5d6d987f1 req-b3b2b454-9a1a-461d-beb0-cf4795a6ee57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e", "tag": "d5c181e8-9634-4dd9-9d76-478532026463"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:35.834595 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-96afa6fc-44c8-463a-836a-7ff5d6d987f1 req-b3b2b454-9a1a-461d-beb0-cf4795a6ee57 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:35.835592 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-96afa6fc-44c8-463a-836a-7ff5d6d987f1 req-b3b2b454-9a1a-461d-beb0-cf4795a6ee57 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:35.918549 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-96afa6fc-44c8-463a-836a-7ff5d6d987f1 req-b3b2b454-9a1a-461d-beb0-cf4795a6ee57 service nova] Creating event network-changed:d5c181e8-9634-4dd9-9d76-478532026463 for instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e on hv-cinder-83697 Jun 20 14:52:35.919159 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-96afa6fc-44c8-463a-836a-7ff5d6d987f1 req-b3b2b454-9a1a-461d-beb0-cf4795a6ee57 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123979) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 14:52:35.920365 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6a7ddc69-eda9-4a61-9387-32b5ee389d1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:35.920883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6a7ddc69-eda9-4a61-9387-32b5ee389d1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:35.923947 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6a7ddc69-eda9-4a61-9387-32b5ee389d1b None None] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:35.925916 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6a7ddc69-eda9-4a61-9387-32b5ee389d1b None None] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:35.963402 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.compute.rpcapi [None req-6a7ddc69-eda9-4a61-9387-32b5ee389d1b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 14:52:35.967173 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6a7ddc69-eda9-4a61-9387-32b5ee389d1b None None] Releasing lock "compute-rpcapi-router" {{(pid=123979) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 14:52:36.049220 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6a7ddc69-eda9-4a61-9387-32b5ee389d1b None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.901432 Jun 20 14:52:36.050216 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 37/65] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:36.400366 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-28bf6e2a-2326-4ca6-856d-681c5e5a33c3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:36.417918 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-28bf6e2a-2326-4ca6-856d-681c5e5a33c3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 1.011508 Jun 20 14:52:36.430737 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 29/66] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:35 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:36.445839 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ad345987-79e2-40c8-9e42-3484bdfddcde tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:36.451097 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ad345987-79e2-40c8-9e42-3484bdfddcde tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:36.468933 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ad345987-79e2-40c8-9e42-3484bdfddcde tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:36.469830 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ad345987-79e2-40c8-9e42-3484bdfddcde tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:36.472284 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ad345987-79e2-40c8-9e42-3484bdfddcde tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:36.474500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ad345987-79e2-40c8-9e42-3484bdfddcde tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:36.776736 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-bdc62a51-631e-48cc-b526-e4414ad1a4eb req-2fac9346-68c6-4b89-a5d7-8c6a0357200c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80267d79-170a-4c4e-b7fe-dfff49c7f195", "tag": "baa0872d-d472-425e-bc75-cdef4f527e6e"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:36.799569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-bdc62a51-631e-48cc-b526-e4414ad1a4eb req-2fac9346-68c6-4b89-a5d7-8c6a0357200c service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:36.802917 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-bdc62a51-631e-48cc-b526-e4414ad1a4eb req-2fac9346-68c6-4b89-a5d7-8c6a0357200c service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:36.866419 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-bdc62a51-631e-48cc-b526-e4414ad1a4eb req-2fac9346-68c6-4b89-a5d7-8c6a0357200c service nova] Creating event network-changed:baa0872d-d472-425e-bc75-cdef4f527e6e for instance 80267d79-170a-4c4e-b7fe-dfff49c7f195 on hv-cinder-83697 Jun 20 14:52:36.891941 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-bdc62a51-631e-48cc-b526-e4414ad1a4eb req-2fac9346-68c6-4b89-a5d7-8c6a0357200c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.830183 Jun 20 14:52:36.897258 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 38/67] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:36.911889 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-eac29aae-b690-4a98-ad2d-553cd2b5ce16 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:36.912596 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-eac29aae-b690-4a98-ad2d-553cd2b5ce16 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:36.948456 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-eac29aae-b690-4a98-ad2d-553cd2b5ce16 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:36.948972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-eac29aae-b690-4a98-ad2d-553cd2b5ce16 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:36.949789 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-eac29aae-b690-4a98-ad2d-553cd2b5ce16 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:36.950228 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-eac29aae-b690-4a98-ad2d-553cd2b5ce16 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:37.494382 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ad345987-79e2-40c8-9e42-3484bdfddcde tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:37.518726 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ad345987-79e2-40c8-9e42-3484bdfddcde tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 1.085405 Jun 20 14:52:37.520250 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 30/68] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:36 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:37.534823 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1a562782-78a3-4fc1-8974-6e18cf9d4abd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:37.535893 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1a562782-78a3-4fc1-8974-6e18cf9d4abd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:37.560733 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1a562782-78a3-4fc1-8974-6e18cf9d4abd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:37.561586 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1a562782-78a3-4fc1-8974-6e18cf9d4abd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:37.565572 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1a562782-78a3-4fc1-8974-6e18cf9d4abd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:37.568052 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1a562782-78a3-4fc1-8974-6e18cf9d4abd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:38.005402 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-eac29aae-b690-4a98-ad2d-553cd2b5ce16 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:38.014433 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-eac29aae-b690-4a98-ad2d-553cd2b5ce16 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 1.115834 Jun 20 14:52:38.022014 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 39/69] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:36 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:38.454087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-42e92a64-64f3-4d60-bd2f-0ed1c6558fd8 req-a729b03f-6843-4b5e-bf0f-5fb0fd187c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d88e00c-10bb-48b8-a343-827831f04e10", "tag": "0932c295-9cbf-4b3f-aa7d-967d7d8030f1"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:38.479587 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-42e92a64-64f3-4d60-bd2f-0ed1c6558fd8 req-a729b03f-6843-4b5e-bf0f-5fb0fd187c6f service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:38.481261 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-42e92a64-64f3-4d60-bd2f-0ed1c6558fd8 req-a729b03f-6843-4b5e-bf0f-5fb0fd187c6f service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:38.512948 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1a562782-78a3-4fc1-8974-6e18cf9d4abd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:38.519899 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-42e92a64-64f3-4d60-bd2f-0ed1c6558fd8 req-a729b03f-6843-4b5e-bf0f-5fb0fd187c6f service nova] Creating event network-changed:0932c295-9cbf-4b3f-aa7d-967d7d8030f1 for instance 5d88e00c-10bb-48b8-a343-827831f04e10 on hv-cinder-83697 Jun 20 14:52:38.532358 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1a562782-78a3-4fc1-8974-6e18cf9d4abd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 1.005822 Jun 20 14:52:38.533603 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 31/70] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:37 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:38.536185 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-42e92a64-64f3-4d60-bd2f-0ed1c6558fd8 req-a729b03f-6843-4b5e-bf0f-5fb0fd187c6f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089794 Jun 20 14:52:38.540192 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 40/71] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 14:52:38.546830 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7a47d121-9208-455e-a21b-644538c5baf2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:38.549791 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7a47d121-9208-455e-a21b-644538c5baf2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:38.576174 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7a47d121-9208-455e-a21b-644538c5baf2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:38.577624 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7a47d121-9208-455e-a21b-644538c5baf2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:38.579729 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7a47d121-9208-455e-a21b-644538c5baf2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:38.582915 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7a47d121-9208-455e-a21b-644538c5baf2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:38.973976 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-96419072-2aca-4558-ba86-0c9e8652c345 req-60ab921a-735f-4b8f-8afc-6c64a7b8708f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4eeab20-5dea-4424-9945-640e8f24f6b0", "tag": "f217b1ab-0950-4d40-a487-def66c16ac43"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:38.994769 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-96419072-2aca-4558-ba86-0c9e8652c345 req-60ab921a-735f-4b8f-8afc-6c64a7b8708f service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:38.995277 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-96419072-2aca-4558-ba86-0c9e8652c345 req-60ab921a-735f-4b8f-8afc-6c64a7b8708f service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:39.035713 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-96419072-2aca-4558-ba86-0c9e8652c345 req-60ab921a-735f-4b8f-8afc-6c64a7b8708f service nova] Creating event network-changed:f217b1ab-0950-4d40-a487-def66c16ac43 for instance a4eeab20-5dea-4424-9945-640e8f24f6b0 on hv-cinder-83697 Jun 20 14:52:39.051082 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-96419072-2aca-4558-ba86-0c9e8652c345 req-60ab921a-735f-4b8f-8afc-6c64a7b8708f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090416 Jun 20 14:52:39.052959 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 41/72] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:39.060793 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-351e2066-508c-40a5-87ee-88015802a4f9 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:39.061498 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-351e2066-508c-40a5-87ee-88015802a4f9 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:39.068708 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-351e2066-508c-40a5-87ee-88015802a4f9 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:39.069182 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-351e2066-508c-40a5-87ee-88015802a4f9 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:39.070408 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-351e2066-508c-40a5-87ee-88015802a4f9 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:39.070849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-351e2066-508c-40a5-87ee-88015802a4f9 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:39.218116 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-7a47d121-9208-455e-a21b-644538c5baf2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:39.231955 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7a47d121-9208-455e-a21b-644538c5baf2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 0.695670 Jun 20 14:52:39.232881 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 32/73] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:38 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:39.486462 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-351e2066-508c-40a5-87ee-88015802a4f9 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:39.495039 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-351e2066-508c-40a5-87ee-88015802a4f9 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.440841 Jun 20 14:52:39.495626 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 42/74] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:39 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:39.550011 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f406500a-b848-4745-8879-9e730e021210 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:39.550628 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f406500a-b848-4745-8879-9e730e021210 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:39.564437 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f406500a-b848-4745-8879-9e730e021210 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:39.564929 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f406500a-b848-4745-8879-9e730e021210 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:39.565696 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f406500a-b848-4745-8879-9e730e021210 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:39.566125 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f406500a-b848-4745-8879-9e730e021210 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:39.750055 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f406500a-b848-4745-8879-9e730e021210 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:39.758857 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f406500a-b848-4745-8879-9e730e021210 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 0.213135 Jun 20 14:52:39.760009 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 33/75] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:39 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:40.250182 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1b66b918-2a79-4bf3-b639-11cc4eef7d45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:40.251377 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-1b66b918-2a79-4bf3-b639-11cc4eef7d45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:40.265553 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1b66b918-2a79-4bf3-b639-11cc4eef7d45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:40.265999 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1b66b918-2a79-4bf3-b639-11cc4eef7d45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:40.266780 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1b66b918-2a79-4bf3-b639-11cc4eef7d45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:40.267213 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1b66b918-2a79-4bf3-b639-11cc4eef7d45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:40.513248 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-013bb64f-0b40-4ec4-9c5f-eb3d1cdde7b5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:40.513864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-013bb64f-0b40-4ec4-9c5f-eb3d1cdde7b5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:40.514823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-1b66b918-2a79-4bf3-b639-11cc4eef7d45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:40.523499 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1b66b918-2a79-4bf3-b639-11cc4eef7d45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 0.277256 Jun 20 14:52:40.524352 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 43/76] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:40 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:40.525357 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-013bb64f-0b40-4ec4-9c5f-eb3d1cdde7b5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:40.525832 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-013bb64f-0b40-4ec4-9c5f-eb3d1cdde7b5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:40.526631 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-013bb64f-0b40-4ec4-9c5f-eb3d1cdde7b5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:40.527055 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-013bb64f-0b40-4ec4-9c5f-eb3d1cdde7b5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:40.690323 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-013bb64f-0b40-4ec4-9c5f-eb3d1cdde7b5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:40.697956 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-013bb64f-0b40-4ec4-9c5f-eb3d1cdde7b5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.190113 Jun 20 14:52:40.698531 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 34/77] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:40 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:52:40.775414 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-5da8a23a-4ac1-4120-9864-cf88fadffb19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:40.776029 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-5da8a23a-4ac1-4120-9864-cf88fadffb19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:40.781751 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:40.783626 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5da8a23a-4ac1-4120-9864-cf88fadffb19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:40.784320 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5da8a23a-4ac1-4120-9864-cf88fadffb19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:40.785406 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5da8a23a-4ac1-4120-9864-cf88fadffb19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:40.786009 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5da8a23a-4ac1-4120-9864-cf88fadffb19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:40.791962 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=99 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:40.940584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-5da8a23a-4ac1-4120-9864-cf88fadffb19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:40.952461 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-5da8a23a-4ac1-4120-9864-cf88fadffb19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 0.180512 Jun 20 14:52:40.954307 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 44/78] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:40 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:41.542156 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e5ac0dda-3928-4379-838c-0eda980510b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:41.543208 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e5ac0dda-3928-4379-838c-0eda980510b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:41.550155 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e5ac0dda-3928-4379-838c-0eda980510b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:41.550868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e5ac0dda-3928-4379-838c-0eda980510b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:41.552088 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e5ac0dda-3928-4379-838c-0eda980510b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:41.552513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e5ac0dda-3928-4379-838c-0eda980510b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:41.717776 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-51ec00b0-569e-4c41-bac6-f88d06e3fbe4 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:41.718688 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-51ec00b0-569e-4c41-bac6-f88d06e3fbe4 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:41.728641 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-51ec00b0-569e-4c41-bac6-f88d06e3fbe4 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:41.729120 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-51ec00b0-569e-4c41-bac6-f88d06e3fbe4 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:41.730042 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-51ec00b0-569e-4c41-bac6-f88d06e3fbe4 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:41.730487 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-51ec00b0-569e-4c41-bac6-f88d06e3fbe4 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:41.743896 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-e5ac0dda-3928-4379-838c-0eda980510b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:41.746726 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=93 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:41.756119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e5ac0dda-3928-4379-838c-0eda980510b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 0.218995 Jun 20 14:52:41.757152 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 35/79] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:41 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:52:41.899509 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-51ec00b0-569e-4c41-bac6-f88d06e3fbe4 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:41.913927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-51ec00b0-569e-4c41-bac6-f88d06e3fbe4 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.202335 Jun 20 14:52:41.914669 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 45/80] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:41 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:52:41.969770 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-79386f7f-5276-4d89-a159-2c9801573a91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:41.970589 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-79386f7f-5276-4d89-a159-2c9801573a91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:41.973883 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:41.996464 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-79386f7f-5276-4d89-a159-2c9801573a91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:41.996464 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-79386f7f-5276-4d89-a159-2c9801573a91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:41.996464 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-79386f7f-5276-4d89-a159-2c9801573a91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:41.996464 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-79386f7f-5276-4d89-a159-2c9801573a91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:42.154603 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-79386f7f-5276-4d89-a159-2c9801573a91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:42.163675 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-79386f7f-5276-4d89-a159-2c9801573a91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 0.197391 Jun 20 14:52:42.167938 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 36/81] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:41 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:42.773838 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-c31bc6cb-9b37-422a-83b1-9c255cd8376a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:42.774463 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-c31bc6cb-9b37-422a-83b1-9c255cd8376a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:42.787442 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c31bc6cb-9b37-422a-83b1-9c255cd8376a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:42.787836 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c31bc6cb-9b37-422a-83b1-9c255cd8376a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:42.789397 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c31bc6cb-9b37-422a-83b1-9c255cd8376a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:42.789828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c31bc6cb-9b37-422a-83b1-9c255cd8376a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:42.931472 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-59f2c397-0540-4fcc-94da-75297ab90476 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:42.933127 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-59f2c397-0540-4fcc-94da-75297ab90476 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:42.947591 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-59f2c397-0540-4fcc-94da-75297ab90476 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:42.948242 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-59f2c397-0540-4fcc-94da-75297ab90476 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:42.949192 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-59f2c397-0540-4fcc-94da-75297ab90476 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:42.949965 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-59f2c397-0540-4fcc-94da-75297ab90476 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:43.078640 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-c31bc6cb-9b37-422a-83b1-9c255cd8376a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:43.100556 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-c31bc6cb-9b37-422a-83b1-9c255cd8376a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 0.331035 Jun 20 14:52:43.101391 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 46/82] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:42 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:43.186149 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-eb2c8bf3-08aa-4909-9381-7dd8afbefb41 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:43.186828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-eb2c8bf3-08aa-4909-9381-7dd8afbefb41 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:43.198751 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-eb2c8bf3-08aa-4909-9381-7dd8afbefb41 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:43.199662 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-eb2c8bf3-08aa-4909-9381-7dd8afbefb41 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:43.203582 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-eb2c8bf3-08aa-4909-9381-7dd8afbefb41 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:43.204190 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-eb2c8bf3-08aa-4909-9381-7dd8afbefb41 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:43.237768 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-59f2c397-0540-4fcc-94da-75297ab90476 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:43.250784 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-59f2c397-0540-4fcc-94da-75297ab90476 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.323771 Jun 20 14:52:43.251940 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 37/83] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:42 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:52:43.372768 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-eb2c8bf3-08aa-4909-9381-7dd8afbefb41 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:43.381027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-eb2c8bf3-08aa-4909-9381-7dd8afbefb41 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 0.200407 Jun 20 14:52:43.383874 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 47/84] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:43 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:44.118471 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3c19b5a5-3ab4-4398-b54c-e89087fc3a2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:44.119088 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-3c19b5a5-3ab4-4398-b54c-e89087fc3a2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:44.142424 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3c19b5a5-3ab4-4398-b54c-e89087fc3a2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:44.142869 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3c19b5a5-3ab4-4398-b54c-e89087fc3a2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:44.155021 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3c19b5a5-3ab4-4398-b54c-e89087fc3a2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:44.155589 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3c19b5a5-3ab4-4398-b54c-e89087fc3a2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:44.272615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-92f7957e-7275-4600-96c5-cfda7f9f4f80 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:44.273354 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-92f7957e-7275-4600-96c5-cfda7f9f4f80 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:44.282973 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-92f7957e-7275-4600-96c5-cfda7f9f4f80 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:44.283994 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-92f7957e-7275-4600-96c5-cfda7f9f4f80 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:44.290023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-92f7957e-7275-4600-96c5-cfda7f9f4f80 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:44.290889 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-92f7957e-7275-4600-96c5-cfda7f9f4f80 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:44.617003 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-92f7957e-7275-4600-96c5-cfda7f9f4f80 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:44.634267 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-92f7957e-7275-4600-96c5-cfda7f9f4f80 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.369400 Jun 20 14:52:44.636570 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 48/85] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:44 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:44.642651 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3c19b5a5-3ab4-4398-b54c-e89087fc3a2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:44.643124 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-60ea09f8-54be-4a51-a480-c229a2fa1c80 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:44.643732 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-60ea09f8-54be-4a51-a480-c229a2fa1c80 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:44.654489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-3c19b5a5-3ab4-4398-b54c-e89087fc3a2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 0.540938 Jun 20 14:52:44.660167 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-60ea09f8-54be-4a51-a480-c229a2fa1c80 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:44.663423 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-60ea09f8-54be-4a51-a480-c229a2fa1c80 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:44.664564 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-60ea09f8-54be-4a51-a480-c229a2fa1c80 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:44.666557 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 38/86] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:44 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:44.667221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-60ea09f8-54be-4a51-a480-c229a2fa1c80 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:45.099905 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-60ea09f8-54be-4a51-a480-c229a2fa1c80 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:45.114955 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-60ea09f8-54be-4a51-a480-c229a2fa1c80 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 0.475083 Jun 20 14:52:45.127469 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 49/87] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:44 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:45.653676 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-fafd8977-c373-4454-9168-760ee8b154c8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:45.654648 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-fafd8977-c373-4454-9168-760ee8b154c8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:45.662205 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fafd8977-c373-4454-9168-760ee8b154c8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:45.662739 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fafd8977-c373-4454-9168-760ee8b154c8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:45.667487 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fafd8977-c373-4454-9168-760ee8b154c8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:45.668296 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fafd8977-c373-4454-9168-760ee8b154c8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:45.671496 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7b2d5d1d-9cf8-4d65-b94e-676767f26ba9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:45.673169 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7b2d5d1d-9cf8-4d65-b94e-676767f26ba9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:45.680902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7b2d5d1d-9cf8-4d65-b94e-676767f26ba9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:45.682498 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7b2d5d1d-9cf8-4d65-b94e-676767f26ba9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:45.684278 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7b2d5d1d-9cf8-4d65-b94e-676767f26ba9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:45.685161 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7b2d5d1d-9cf8-4d65-b94e-676767f26ba9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:45.857646 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7b2d5d1d-9cf8-4d65-b94e-676767f26ba9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:45.868190 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7b2d5d1d-9cf8-4d65-b94e-676767f26ba9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 0.200411 Jun 20 14:52:45.878262 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 50/88] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:45 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:45.902970 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-fafd8977-c373-4454-9168-760ee8b154c8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:45.917238 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-fafd8977-c373-4454-9168-760ee8b154c8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.267409 Jun 20 14:52:45.918550 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 39/89] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:45 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:46.133410 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8b5ec0fe-a573-4f33-93d0-e1de71f67cb2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:46.134021 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-8b5ec0fe-a573-4f33-93d0-e1de71f67cb2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:46.135889 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:46.144898 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8b5ec0fe-a573-4f33-93d0-e1de71f67cb2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:46.145338 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8b5ec0fe-a573-4f33-93d0-e1de71f67cb2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:46.146280 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8b5ec0fe-a573-4f33-93d0-e1de71f67cb2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:46.146705 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8b5ec0fe-a573-4f33-93d0-e1de71f67cb2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:46.329072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8b5ec0fe-a573-4f33-93d0-e1de71f67cb2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:46.338398 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-8b5ec0fe-a573-4f33-93d0-e1de71f67cb2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 0.208729 Jun 20 14:52:46.339383 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 51/90] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:46 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:46.886775 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b9d1a100-ed20-4dd2-bad5-800258081ba7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:46.888232 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-b9d1a100-ed20-4dd2-bad5-800258081ba7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:46.905977 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b9d1a100-ed20-4dd2-bad5-800258081ba7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:46.908221 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b9d1a100-ed20-4dd2-bad5-800258081ba7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:46.911846 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b9d1a100-ed20-4dd2-bad5-800258081ba7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:46.917240 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b9d1a100-ed20-4dd2-bad5-800258081ba7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:46.933542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-222421ba-23e2-4ab3-81a6-e29b2724b579 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:46.934137 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-222421ba-23e2-4ab3-81a6-e29b2724b579 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:46.943642 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-222421ba-23e2-4ab3-81a6-e29b2724b579 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:46.945664 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-222421ba-23e2-4ab3-81a6-e29b2724b579 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:46.947578 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-222421ba-23e2-4ab3-81a6-e29b2724b579 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:46.949228 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-222421ba-23e2-4ab3-81a6-e29b2724b579 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:47.221012 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-b9d1a100-ed20-4dd2-bad5-800258081ba7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:47.230524 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b9d1a100-ed20-4dd2-bad5-800258081ba7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 0.348833 Jun 20 14:52:47.243591 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 40/91] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:46 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:47.257502 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-222421ba-23e2-4ab3-81a6-e29b2724b579 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:47.267830 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-222421ba-23e2-4ab3-81a6-e29b2724b579 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.338013 Jun 20 14:52:47.274246 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 52/92] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:46 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:47.324905 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-17974917-564b-4950-964e-fa590b37f69c req-175437ca-7087-4bdc-b85c-fa7b4a7ba70e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80267d79-170a-4c4e-b7fe-dfff49c7f195", "name": "network-vif-plugged", "status": "completed", "tag": "baa0872d-d472-425e-bc75-cdef4f527e6e"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:47.348246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-17974917-564b-4950-964e-fa590b37f69c req-175437ca-7087-4bdc-b85c-fa7b4a7ba70e service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:47.349081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-17974917-564b-4950-964e-fa590b37f69c req-175437ca-7087-4bdc-b85c-fa7b4a7ba70e service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:47.359268 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ed2d7a08-7e2e-42f0-9d4c-1304fc89afc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:47.359990 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ed2d7a08-7e2e-42f0-9d4c-1304fc89afc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:47.379029 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-17974917-564b-4950-964e-fa590b37f69c req-175437ca-7087-4bdc-b85c-fa7b4a7ba70e service nova] Creating event network-vif-plugged:baa0872d-d472-425e-bc75-cdef4f527e6e for instance 80267d79-170a-4c4e-b7fe-dfff49c7f195 on hv-cinder-83697 Jun 20 14:52:47.379768 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-17974917-564b-4950-964e-fa590b37f69c req-175437ca-7087-4bdc-b85c-fa7b4a7ba70e service nova] Acquired lock "compute-rpcapi-router" {{(pid=123978) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 14:52:47.381044 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e892802-e08e-4084-a90b-d9861c0cfb40 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:47.381661 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e892802-e08e-4084-a90b-d9861c0cfb40 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:47.383046 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e892802-e08e-4084-a90b-d9861c0cfb40 None None] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:47.383623 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e892802-e08e-4084-a90b-d9861c0cfb40 None None] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:47.385931 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ed2d7a08-7e2e-42f0-9d4c-1304fc89afc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:47.386317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ed2d7a08-7e2e-42f0-9d4c-1304fc89afc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:47.387094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ed2d7a08-7e2e-42f0-9d4c-1304fc89afc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:47.398508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.compute.rpcapi [None req-4e892802-e08e-4084-a90b-d9861c0cfb40 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 14:52:47.399281 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ed2d7a08-7e2e-42f0-9d4c-1304fc89afc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:47.400277 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e892802-e08e-4084-a90b-d9861c0cfb40 None None] Releasing lock "compute-rpcapi-router" {{(pid=123978) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 14:52:47.452507 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-4e892802-e08e-4084-a90b-d9861c0cfb40 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207225 Jun 20 14:52:47.456520 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 41/93] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:47.668059 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ed2d7a08-7e2e-42f0-9d4c-1304fc89afc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:47.673716 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ed2d7a08-7e2e-42f0-9d4c-1304fc89afc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 0.320983 Jun 20 14:52:47.684197 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 53/94] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:47 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:48.262207 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7b278fb2-aa41-4b33-b7b4-e7d5a65d90f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:48.264469 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7b278fb2-aa41-4b33-b7b4-e7d5a65d90f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:48.291783 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7b278fb2-aa41-4b33-b7b4-e7d5a65d90f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:48.292516 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7b278fb2-aa41-4b33-b7b4-e7d5a65d90f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:48.293211 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-28993fd7-87f9-4b41-b27f-a0793616a403 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:48.294329 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-28993fd7-87f9-4b41-b27f-a0793616a403 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:48.295821 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7b278fb2-aa41-4b33-b7b4-e7d5a65d90f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:48.298610 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7b278fb2-aa41-4b33-b7b4-e7d5a65d90f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:48.315177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-28993fd7-87f9-4b41-b27f-a0793616a403 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:48.320582 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-28993fd7-87f9-4b41-b27f-a0793616a403 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:48.322194 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-28993fd7-87f9-4b41-b27f-a0793616a403 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:48.328047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-28993fd7-87f9-4b41-b27f-a0793616a403 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:48.569064 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-7b278fb2-aa41-4b33-b7b4-e7d5a65d90f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:48.580441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7b278fb2-aa41-4b33-b7b4-e7d5a65d90f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 0.332709 Jun 20 14:52:48.581778 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 42/95] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:48 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:48.692314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-408e27bf-9433-486a-a880-e0fb47affbe3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:48.693216 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-408e27bf-9433-486a-a880-e0fb47affbe3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:48.705987 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-408e27bf-9433-486a-a880-e0fb47affbe3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:48.713644 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-408e27bf-9433-486a-a880-e0fb47affbe3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:48.714482 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-408e27bf-9433-486a-a880-e0fb47affbe3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:48.714922 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-408e27bf-9433-486a-a880-e0fb47affbe3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:48.719610 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-28993fd7-87f9-4b41-b27f-a0793616a403 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:48.730651 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-28993fd7-87f9-4b41-b27f-a0793616a403 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.444995 Jun 20 14:52:48.731619 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 54/96] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:48 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:52:48.907047 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-408e27bf-9433-486a-a880-e0fb47affbe3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:48.915399 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-408e27bf-9433-486a-a880-e0fb47affbe3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 0.227180 Jun 20 14:52:48.924559 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 43/97] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:48 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:49.597502 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d60ae895-37ca-492d-885a-4bdb2dc92038 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:49.598177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d60ae895-37ca-492d-885a-4bdb2dc92038 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:49.604209 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d60ae895-37ca-492d-885a-4bdb2dc92038 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:49.604649 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d60ae895-37ca-492d-885a-4bdb2dc92038 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:49.605433 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d60ae895-37ca-492d-885a-4bdb2dc92038 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:49.605863 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d60ae895-37ca-492d-885a-4bdb2dc92038 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:49.749100 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f9559447-0219-4f52-8829-d5bb7a4067e0 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:49.750787 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f9559447-0219-4f52-8829-d5bb7a4067e0 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:49.762200 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f9559447-0219-4f52-8829-d5bb7a4067e0 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:49.762781 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f9559447-0219-4f52-8829-d5bb7a4067e0 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:49.766733 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f9559447-0219-4f52-8829-d5bb7a4067e0 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:49.767415 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f9559447-0219-4f52-8829-d5bb7a4067e0 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:49.772552 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d60ae895-37ca-492d-885a-4bdb2dc92038 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:49.780378 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d60ae895-37ca-492d-885a-4bdb2dc92038 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 0.186575 Jun 20 14:52:49.783937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 55/98] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:49 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:49.931888 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-f62a1be3-488f-4973-9698-a77ebaa10342 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:49.932494 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-f62a1be3-488f-4973-9698-a77ebaa10342 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:49.940385 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f62a1be3-488f-4973-9698-a77ebaa10342 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:49.940861 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f62a1be3-488f-4973-9698-a77ebaa10342 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:49.941624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f62a1be3-488f-4973-9698-a77ebaa10342 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:49.942041 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f62a1be3-488f-4973-9698-a77ebaa10342 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:49.942519 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f9559447-0219-4f52-8829-d5bb7a4067e0 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:49.952601 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f9559447-0219-4f52-8829-d5bb7a4067e0 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.208726 Jun 20 14:52:49.953559 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 44/99] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:49 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:52:50.150041 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-f62a1be3-488f-4973-9698-a77ebaa10342 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:50.158484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-f62a1be3-488f-4973-9698-a77ebaa10342 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 0.230483 Jun 20 14:52:50.159011 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 56/100] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:49 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:52:50.801977 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-300d738d-e089-443d-a464-5a98a203dc5c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:50.802596 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-300d738d-e089-443d-a464-5a98a203dc5c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:50.809078 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-300d738d-e089-443d-a464-5a98a203dc5c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:50.809518 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-300d738d-e089-443d-a464-5a98a203dc5c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:50.810270 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-300d738d-e089-443d-a464-5a98a203dc5c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:50.810694 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-300d738d-e089-443d-a464-5a98a203dc5c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:50.955398 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-300d738d-e089-443d-a464-5a98a203dc5c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:50.965027 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-300d738d-e089-443d-a464-5a98a203dc5c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 0.168204 Jun 20 14:52:50.966675 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 45/101] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:50 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:50.970200 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b1e23439-37fb-4990-bfa7-9fb39d803abc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:50.970804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-b1e23439-37fb-4990-bfa7-9fb39d803abc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:50.979111 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b1e23439-37fb-4990-bfa7-9fb39d803abc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:50.979964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b1e23439-37fb-4990-bfa7-9fb39d803abc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:50.981700 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b1e23439-37fb-4990-bfa7-9fb39d803abc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:50.982195 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b1e23439-37fb-4990-bfa7-9fb39d803abc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:51.138225 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-b1e23439-37fb-4990-bfa7-9fb39d803abc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:51.150687 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-b1e23439-37fb-4990-bfa7-9fb39d803abc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.182938 Jun 20 14:52:51.160229 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 57/102] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:50 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:52:51.175503 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-eab100ca-b40c-4d4b-af7d-a4c7b3b8b090 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:51.175790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-eab100ca-b40c-4d4b-af7d-a4c7b3b8b090 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:51.184885 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eab100ca-b40c-4d4b-af7d-a4c7b3b8b090 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:51.184885 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eab100ca-b40c-4d4b-af7d-a4c7b3b8b090 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:51.184885 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eab100ca-b40c-4d4b-af7d-a4c7b3b8b090 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:51.185100 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eab100ca-b40c-4d4b-af7d-a4c7b3b8b090 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:51.352522 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-eab100ca-b40c-4d4b-af7d-a4c7b3b8b090 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:51.360800 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-eab100ca-b40c-4d4b-af7d-a4c7b3b8b090 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 0.189392 Jun 20 14:52:51.361963 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 46/103] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:51 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:51.986967 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3e4f7c03-92eb-4513-b251-d9b24d420e45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:51.988673 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3e4f7c03-92eb-4513-b251-d9b24d420e45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:51.990114 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-07e3b3b9-589c-42f9-a3e4-317277501b0d req-8ac20c04-9097-49fc-a60b-d3c671eaa12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e", "name": "network-vif-plugged", "status": "completed", "tag": "d5c181e8-9634-4dd9-9d76-478532026463"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:51.998645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-07e3b3b9-589c-42f9-a3e4-317277501b0d req-8ac20c04-9097-49fc-a60b-d3c671eaa12e service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:51.999249 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-07e3b3b9-589c-42f9-a3e4-317277501b0d req-8ac20c04-9097-49fc-a60b-d3c671eaa12e service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:52.001320 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3e4f7c03-92eb-4513-b251-d9b24d420e45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:52.002197 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3e4f7c03-92eb-4513-b251-d9b24d420e45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:52.003153 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3e4f7c03-92eb-4513-b251-d9b24d420e45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:52.004451 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3e4f7c03-92eb-4513-b251-d9b24d420e45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:52.016802 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-07e3b3b9-589c-42f9-a3e4-317277501b0d req-8ac20c04-9097-49fc-a60b-d3c671eaa12e service nova] Creating event network-vif-plugged:d5c181e8-9634-4dd9-9d76-478532026463 for instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e on hv-cinder-83697 Jun 20 14:52:52.023303 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-07e3b3b9-589c-42f9-a3e4-317277501b0d req-8ac20c04-9097-49fc-a60b-d3c671eaa12e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036863 Jun 20 14:52:52.024117 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 47/104] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 14:52:52.168059 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d0d911ab-e8e3-44f6-879f-f158064f4441 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:52.169011 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-d0d911ab-e8e3-44f6-879f-f158064f4441 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:52.181512 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d0d911ab-e8e3-44f6-879f-f158064f4441 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:52.181966 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d0d911ab-e8e3-44f6-879f-f158064f4441 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:52.182748 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d0d911ab-e8e3-44f6-879f-f158064f4441 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:52.183175 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d0d911ab-e8e3-44f6-879f-f158064f4441 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:52.247799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3e4f7c03-92eb-4513-b251-d9b24d420e45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:52.256346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3e4f7c03-92eb-4513-b251-d9b24d420e45 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 0.277179 Jun 20 14:52:52.256982 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 58/105] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:51 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:52.385024 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6f22ce7a-06be-4e32-8d90-0c4c017cf2d2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:52.386074 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-6f22ce7a-06be-4e32-8d90-0c4c017cf2d2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:52.396736 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6f22ce7a-06be-4e32-8d90-0c4c017cf2d2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:52.397623 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6f22ce7a-06be-4e32-8d90-0c4c017cf2d2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:52.403234 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6f22ce7a-06be-4e32-8d90-0c4c017cf2d2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:52.405134 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6f22ce7a-06be-4e32-8d90-0c4c017cf2d2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:52.640405 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6f22ce7a-06be-4e32-8d90-0c4c017cf2d2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:52.657777 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6f22ce7a-06be-4e32-8d90-0c4c017cf2d2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 0.283463 Jun 20 14:52:52.670315 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 59/106] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:52 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:52.696676 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d0d911ab-e8e3-44f6-879f-f158064f4441 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:52.714743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d0d911ab-e8e3-44f6-879f-f158064f4441 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.550715 Jun 20 14:52:52.724863 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 48/107] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:52 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:52:53.274427 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d166f3e1-eab2-4236-8616-9e8feb4eb200 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:53.275085 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d166f3e1-eab2-4236-8616-9e8feb4eb200 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:53.282453 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d166f3e1-eab2-4236-8616-9e8feb4eb200 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:53.283111 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d166f3e1-eab2-4236-8616-9e8feb4eb200 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:53.284052 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d166f3e1-eab2-4236-8616-9e8feb4eb200 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:53.284481 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d166f3e1-eab2-4236-8616-9e8feb4eb200 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:53.475958 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d166f3e1-eab2-4236-8616-9e8feb4eb200 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:53.479918 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=100 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:53.485585 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d166f3e1-eab2-4236-8616-9e8feb4eb200 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 0.215106 Jun 20 14:52:53.486287 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 60/108] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:53 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:53.677374 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-cb1ad1d9-0a30-473b-9095-0f2ae938779b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:53.678094 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-cb1ad1d9-0a30-473b-9095-0f2ae938779b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:53.686060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cb1ad1d9-0a30-473b-9095-0f2ae938779b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:53.686740 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cb1ad1d9-0a30-473b-9095-0f2ae938779b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:53.687749 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cb1ad1d9-0a30-473b-9095-0f2ae938779b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:53.688367 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cb1ad1d9-0a30-473b-9095-0f2ae938779b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:53.746720 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3446f3b1-1ee8-46c8-b0ea-c086b63a17ae tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:53.747532 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3446f3b1-1ee8-46c8-b0ea-c086b63a17ae tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:53.755067 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3446f3b1-1ee8-46c8-b0ea-c086b63a17ae tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:53.755876 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3446f3b1-1ee8-46c8-b0ea-c086b63a17ae tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:53.757114 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3446f3b1-1ee8-46c8-b0ea-c086b63a17ae tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:53.757733 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3446f3b1-1ee8-46c8-b0ea-c086b63a17ae tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:53.889290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-cb1ad1d9-0a30-473b-9095-0f2ae938779b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:53.896829 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-cb1ad1d9-0a30-473b-9095-0f2ae938779b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1364 microversion: 2.1 time: 0.223484 Jun 20 14:52:53.900539 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 49/109] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:53 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:53.972562 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3446f3b1-1ee8-46c8-b0ea-c086b63a17ae tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:53.980541 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3446f3b1-1ee8-46c8-b0ea-c086b63a17ae tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.242368 Jun 20 14:52:53.981141 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 61/110] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:53 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:54.042044 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-5ee158ac-d1df-43f8-b7a7-39a2809cd225 req-4409dc4b-6c82-4da4-9ed8-02d0e3e4e9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d88e00c-10bb-48b8-a343-827831f04e10", "name": "network-vif-plugged", "status": "completed", "tag": "0932c295-9cbf-4b3f-aa7d-967d7d8030f1"}, {"server_uuid": "a4eeab20-5dea-4424-9945-640e8f24f6b0", "name": "network-vif-plugged", "status": "completed", "tag": "f217b1ab-0950-4d40-a487-def66c16ac43"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:54.050936 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-5ee158ac-d1df-43f8-b7a7-39a2809cd225 req-4409dc4b-6c82-4da4-9ed8-02d0e3e4e9d5 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:54.051368 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-5ee158ac-d1df-43f8-b7a7-39a2809cd225 req-4409dc4b-6c82-4da4-9ed8-02d0e3e4e9d5 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:54.064809 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-5ee158ac-d1df-43f8-b7a7-39a2809cd225 req-4409dc4b-6c82-4da4-9ed8-02d0e3e4e9d5 service nova] Creating event network-vif-plugged:0932c295-9cbf-4b3f-aa7d-967d7d8030f1 for instance 5d88e00c-10bb-48b8-a343-827831f04e10 on hv-cinder-83697 Jun 20 14:52:54.065528 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-5ee158ac-d1df-43f8-b7a7-39a2809cd225 req-4409dc4b-6c82-4da4-9ed8-02d0e3e4e9d5 service nova] Creating event network-vif-plugged:f217b1ab-0950-4d40-a487-def66c16ac43 for instance a4eeab20-5dea-4424-9945-640e8f24f6b0 on hv-cinder-83697 Jun 20 14:52:54.072045 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-5ee158ac-d1df-43f8-b7a7-39a2809cd225 req-4409dc4b-6c82-4da4-9ed8-02d0e3e4e9d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033992 Jun 20 14:52:54.072626 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 50/111] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:54.503181 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-5be17ad6-6ad5-41b2-a889-ff2f1bd63ca8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:54.503871 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-5be17ad6-6ad5-41b2-a889-ff2f1bd63ca8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:54.521727 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5be17ad6-6ad5-41b2-a889-ff2f1bd63ca8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:54.524176 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5be17ad6-6ad5-41b2-a889-ff2f1bd63ca8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:54.525278 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5be17ad6-6ad5-41b2-a889-ff2f1bd63ca8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:54.527733 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5be17ad6-6ad5-41b2-a889-ff2f1bd63ca8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:54.751760 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-5be17ad6-6ad5-41b2-a889-ff2f1bd63ca8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:54.762526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-5be17ad6-6ad5-41b2-a889-ff2f1bd63ca8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 0.263568 Jun 20 14:52:54.774749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 62/112] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:54 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:54.918440 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-33b67edd-cf33-4fac-939a-eb4b99a56a65 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:54.919304 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-33b67edd-cf33-4fac-939a-eb4b99a56a65 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:54.933854 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-33b67edd-cf33-4fac-939a-eb4b99a56a65 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:54.934313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-33b67edd-cf33-4fac-939a-eb4b99a56a65 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:54.935110 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-33b67edd-cf33-4fac-939a-eb4b99a56a65 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:54.938454 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-33b67edd-cf33-4fac-939a-eb4b99a56a65 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:54.999821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-81ba8144-5f6d-4edb-8d1e-98472b3ec0cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:55.000800 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-81ba8144-5f6d-4edb-8d1e-98472b3ec0cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:55.011761 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-81ba8144-5f6d-4edb-8d1e-98472b3ec0cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:55.015358 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-81ba8144-5f6d-4edb-8d1e-98472b3ec0cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:55.018057 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-81ba8144-5f6d-4edb-8d1e-98472b3ec0cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:55.019084 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-81ba8144-5f6d-4edb-8d1e-98472b3ec0cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:55.186375 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-33b67edd-cf33-4fac-939a-eb4b99a56a65 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:55.195697 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-33b67edd-cf33-4fac-939a-eb4b99a56a65 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1553 microversion: 2.1 time: 0.284042 Jun 20 14:52:55.208681 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 51/113] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:54 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1553 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:55.214457 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6c2910d9-9dea-48ed-8b47-f55063b9e680 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:55.215012 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6c2910d9-9dea-48ed-8b47-f55063b9e680 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:55.221184 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6c2910d9-9dea-48ed-8b47-f55063b9e680 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:55.221634 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6c2910d9-9dea-48ed-8b47-f55063b9e680 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:55.222455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6c2910d9-9dea-48ed-8b47-f55063b9e680 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:55.222888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6c2910d9-9dea-48ed-8b47-f55063b9e680 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:55.265910 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-81ba8144-5f6d-4edb-8d1e-98472b3ec0cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:55.273703 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-81ba8144-5f6d-4edb-8d1e-98472b3ec0cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.279926 Jun 20 14:52:55.274278 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 63/114] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:54 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:52:55.359070 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6c2910d9-9dea-48ed-8b47-f55063b9e680 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149220 Jun 20 14:52:55.359674 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 52/115] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 14:52:55 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 14:52:55.779942 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-c39c57e2-309e-4c76-bd51-0007d2c6a06f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:55.782445 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-c39c57e2-309e-4c76-bd51-0007d2c6a06f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:55.792861 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c39c57e2-309e-4c76-bd51-0007d2c6a06f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:55.795413 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c39c57e2-309e-4c76-bd51-0007d2c6a06f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:55.796528 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c39c57e2-309e-4c76-bd51-0007d2c6a06f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:55.797184 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c39c57e2-309e-4c76-bd51-0007d2c6a06f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:56.082307 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-c39c57e2-309e-4c76-bd51-0007d2c6a06f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:56.096378 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-c39c57e2-309e-4c76-bd51-0007d2c6a06f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1322 microversion: 2.1 time: 0.316770 Jun 20 14:52:56.099044 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 64/116] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:55 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:56.291376 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ee132971-a527-4070-9dae-e93b573af8fd tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:56.296844 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ee132971-a527-4070-9dae-e93b573af8fd tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:56.305793 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ee132971-a527-4070-9dae-e93b573af8fd tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:56.306376 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ee132971-a527-4070-9dae-e93b573af8fd tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:56.307179 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ee132971-a527-4070-9dae-e93b573af8fd tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:56.309191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ee132971-a527-4070-9dae-e93b573af8fd tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:56.825809 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ee132971-a527-4070-9dae-e93b573af8fd tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:56.833260 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ee132971-a527-4070-9dae-e93b573af8fd tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1314 microversion: 2.1 time: 0.546441 Jun 20 14:52:56.843233 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 53/117] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:56 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:57.116442 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-39102273-8679-441a-8ff0-8e62dde14b06 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:57.117321 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-39102273-8679-441a-8ff0-8e62dde14b06 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:57.126861 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-39102273-8679-441a-8ff0-8e62dde14b06 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:57.128492 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-39102273-8679-441a-8ff0-8e62dde14b06 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:57.129741 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-39102273-8679-441a-8ff0-8e62dde14b06 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:57.130234 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-39102273-8679-441a-8ff0-8e62dde14b06 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:57.327944 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-68e10f94-25d3-4ef4-a980-102d872f9fa7 req-57616b1c-7e9e-4342-b754-707dd03dffa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e", "tag": "d5c181e8-9634-4dd9-9d76-478532026463"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:57.337479 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-68e10f94-25d3-4ef4-a980-102d872f9fa7 req-57616b1c-7e9e-4342-b754-707dd03dffa0 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:57.337915 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-68e10f94-25d3-4ef4-a980-102d872f9fa7 req-57616b1c-7e9e-4342-b754-707dd03dffa0 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:57.352560 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-68e10f94-25d3-4ef4-a980-102d872f9fa7 req-57616b1c-7e9e-4342-b754-707dd03dffa0 service nova] Creating event network-changed:d5c181e8-9634-4dd9-9d76-478532026463 for instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e on hv-cinder-83697 Jun 20 14:52:57.360027 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-68e10f94-25d3-4ef4-a980-102d872f9fa7 req-57616b1c-7e9e-4342-b754-707dd03dffa0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036739 Jun 20 14:52:57.364631 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 54/118] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:52:57.817565 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-39102273-8679-441a-8ff0-8e62dde14b06 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:57.837217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-39102273-8679-441a-8ff0-8e62dde14b06 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1517 microversion: 2.1 time: 0.725984 Jun 20 14:52:57.853860 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 65/119] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:57 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1517 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:57.858313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-8a8c1d31-b795-412c-8a42-f9ba2089f332 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:57.859052 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-8a8c1d31-b795-412c-8a42-f9ba2089f332 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:57.860362 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-88956f33-5373-4903-9bdb-e67c07585c52 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:57.862050 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-88956f33-5373-4903-9bdb-e67c07585c52 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:57.868705 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:57.872041 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-88956f33-5373-4903-9bdb-e67c07585c52 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:57.872760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8a8c1d31-b795-412c-8a42-f9ba2089f332 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:57.872896 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-88956f33-5373-4903-9bdb-e67c07585c52 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:57.874587 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-88956f33-5373-4903-9bdb-e67c07585c52 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:57.875244 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8a8c1d31-b795-412c-8a42-f9ba2089f332 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:57.875472 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-88956f33-5373-4903-9bdb-e67c07585c52 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:57.876460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8a8c1d31-b795-412c-8a42-f9ba2089f332 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:57.877110 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8a8c1d31-b795-412c-8a42-f9ba2089f332 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:57.888414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=100 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:58.039956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.objects.instance [None req-88956f33-5373-4903-9bdb-e67c07585c52 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lazy-loading 'flavor' on Instance uuid 5d88e00c-10bb-48b8-a343-827831f04e10 {{(pid=123979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:52:58.251234 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-8a8c1d31-b795-412c-8a42-f9ba2089f332 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:58.261470 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-8a8c1d31-b795-412c-8a42-f9ba2089f332 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1500 microversion: 2.1 time: 0.407243 Jun 20 14:52:58.262825 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 55/120] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:57 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1500 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:52:58.308726 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-88956f33-5373-4903-9bdb-e67c07585c52 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "POST /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10/action" status: 200 len: 32 microversion: 2.1 time: 0.452207 Jun 20 14:52:58.311765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 66/121] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 14:52:57 2022] POST /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10/action => generated 32 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 14:52:58.322557 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b1864b7b-4561-4b3f-9a3e-87333c243842 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:58.323181 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-b1864b7b-4561-4b3f-9a3e-87333c243842 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:58.334869 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b1864b7b-4561-4b3f-9a3e-87333c243842 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:58.335454 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b1864b7b-4561-4b3f-9a3e-87333c243842 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:58.338162 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b1864b7b-4561-4b3f-9a3e-87333c243842 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:58.341390 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b1864b7b-4561-4b3f-9a3e-87333c243842 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:58.637970 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-b1864b7b-4561-4b3f-9a3e-87333c243842 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:58.646954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b1864b7b-4561-4b3f-9a3e-87333c243842 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.330212 Jun 20 14:52:58.660568 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 56/122] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:58 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:59.669391 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d7a2419b-3794-4b15-8177-a6c569cdca7f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:52:59.670316 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d7a2419b-3794-4b15-8177-a6c569cdca7f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:59.681810 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d7a2419b-3794-4b15-8177-a6c569cdca7f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:59.682446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d7a2419b-3794-4b15-8177-a6c569cdca7f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:59.683385 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d7a2419b-3794-4b15-8177-a6c569cdca7f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:59.684009 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d7a2419b-3794-4b15-8177-a6c569cdca7f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:59.841135 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d7a2419b-3794-4b15-8177-a6c569cdca7f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:52:59.849886 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d7a2419b-3794-4b15-8177-a6c569cdca7f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.185639 Jun 20 14:52:59.850863 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 67/123] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:52:59 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:52:59.876252 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6d8d48b5-4836-408a-a543-9a65ff897881 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3deb64f9-733b-4ba9-bc5e-8bb3662342a3"}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:52:59.877480 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6d8d48b5-4836-408a-a543-9a65ff897881 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:52:59.884914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6d8d48b5-4836-408a-a543-9a65ff897881 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:59.885369 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6d8d48b5-4836-408a-a543-9a65ff897881 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:52:59.886519 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6d8d48b5-4836-408a-a543-9a65ff897881 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:52:59.887170 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6d8d48b5-4836-408a-a543-9a65ff897881 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:00.227316 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6d8d48b5-4836-408a-a543-9a65ff897881 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "POST /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.355000 Jun 20 14:53:00.227960 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 57/124] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 14:52:59 2022] POST /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:53:00.868275 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-985025b7-525d-4ec4-8c8e-9e6481aa10f2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:00.869556 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-985025b7-525d-4ec4-8c8e-9e6481aa10f2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:00.880865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-985025b7-525d-4ec4-8c8e-9e6481aa10f2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:00.882157 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-985025b7-525d-4ec4-8c8e-9e6481aa10f2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:00.884653 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-985025b7-525d-4ec4-8c8e-9e6481aa10f2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:00.886987 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-985025b7-525d-4ec4-8c8e-9e6481aa10f2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:00.982268 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1285796813", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "networks": [{"uuid": "156bc734-fceb-4cfe-9464-367866d760d0"}]}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:53:01.079262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.network.neutron [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] validate_networks() for [('156bc734-fceb-4cfe-9464-367866d760d0', None, None, None, None, None)] {{(pid=123978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:53:01.149744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-985025b7-525d-4ec4-8c8e-9e6481aa10f2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:01.161980 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-985025b7-525d-4ec4-8c8e-9e6481aa10f2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.298230 Jun 20 14:53:01.162546 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 68/125] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:00 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:01.597340 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Flavor limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:53:01.597746 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Image limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:53:01.598201 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Flavor pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:53:01.598593 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Image pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:53:01.598988 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:53:01.609197 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:01.609799 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:01.610605 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:01.611033 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:01.631319 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Getting quotas for project c461f88b7a00462c99532ec1262cb23c. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:53:01.637100 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Getting quotas for user a4a159cc0128485482851c885de78e5d and project c461f88b7a00462c99532ec1262cb23c. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:53:01.652858 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Going to run 1 instances... {{(pid=123978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:53:01.656037 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:53:01.717343 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-80661b28-58d8-4846-8ec0-ee648207f3ad tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740754 Jun 20 14:53:01.718824 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 58/126] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 14:53:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 14:53:01.728617 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-4e37dced-a563-4bd1-9f9c-8e0998467ae9 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:01.730119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-4e37dced-a563-4bd1-9f9c-8e0998467ae9 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:01.786630 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-4e37dced-a563-4bd1-9f9c-8e0998467ae9 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:01.799210 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-4e37dced-a563-4bd1-9f9c-8e0998467ae9 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1214 microversion: 2.1 time: 0.074357 Jun 20 14:53:01.800027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 69/127] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:01 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:02.192708 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1215327e-b9fb-428a-88b3-e0051f0b791a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:02.194537 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1215327e-b9fb-428a-88b3-e0051f0b791a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:02.204588 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1215327e-b9fb-428a-88b3-e0051f0b791a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:02.205070 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1215327e-b9fb-428a-88b3-e0051f0b791a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:02.206118 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1215327e-b9fb-428a-88b3-e0051f0b791a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:02.207107 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1215327e-b9fb-428a-88b3-e0051f0b791a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:02.371624 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1215327e-b9fb-428a-88b3-e0051f0b791a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:02.389860 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1215327e-b9fb-428a-88b3-e0051f0b791a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.208717 Jun 20 14:53:02.404384 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 59/128] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:02 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:02.816624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ee1707bf-34e7-4508-a564-8512b9b5405f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:02.817261 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ee1707bf-34e7-4508-a564-8512b9b5405f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:02.823577 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ee1707bf-34e7-4508-a564-8512b9b5405f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:02.824044 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ee1707bf-34e7-4508-a564-8512b9b5405f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:02.824869 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ee1707bf-34e7-4508-a564-8512b9b5405f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:02.825301 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ee1707bf-34e7-4508-a564-8512b9b5405f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:02.891935 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ee1707bf-34e7-4508-a564-8512b9b5405f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:02.900062 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ee1707bf-34e7-4508-a564-8512b9b5405f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1218 microversion: 2.1 time: 0.087650 Jun 20 14:53:02.900619 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 70/129] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:02 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:03.408733 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-20020d75-c703-4a6a-b015-1b2c0bedf677 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:03.409353 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-20020d75-c703-4a6a-b015-1b2c0bedf677 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:03.415788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-20020d75-c703-4a6a-b015-1b2c0bedf677 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:03.416275 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-20020d75-c703-4a6a-b015-1b2c0bedf677 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:03.417026 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-20020d75-c703-4a6a-b015-1b2c0bedf677 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:03.417450 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-20020d75-c703-4a6a-b015-1b2c0bedf677 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:03.570820 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-20020d75-c703-4a6a-b015-1b2c0bedf677 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:03.578666 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-20020d75-c703-4a6a-b015-1b2c0bedf677 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.174990 Jun 20 14:53:03.579463 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 60/130] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:03 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:03.918529 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0fcdda83-c45e-484b-afd1-5e7c719ac92d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:03.919081 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-0fcdda83-c45e-484b-afd1-5e7c719ac92d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:03.926077 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0fcdda83-c45e-484b-afd1-5e7c719ac92d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:03.926553 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0fcdda83-c45e-484b-afd1-5e7c719ac92d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:03.927351 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0fcdda83-c45e-484b-afd1-5e7c719ac92d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:03.927799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0fcdda83-c45e-484b-afd1-5e7c719ac92d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:03.997435 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0fcdda83-c45e-484b-afd1-5e7c719ac92d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:04.007391 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0fcdda83-c45e-484b-afd1-5e7c719ac92d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1210 microversion: 2.1 time: 0.092931 Jun 20 14:53:04.007937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 71/131] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:03 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:04.595853 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-eecb7329-0b36-496a-aea5-69f5db539b75 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:04.596748 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-eecb7329-0b36-496a-aea5-69f5db539b75 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:04.609536 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eecb7329-0b36-496a-aea5-69f5db539b75 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:04.610148 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eecb7329-0b36-496a-aea5-69f5db539b75 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:04.610933 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eecb7329-0b36-496a-aea5-69f5db539b75 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:04.611449 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eecb7329-0b36-496a-aea5-69f5db539b75 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:04.829227 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-eecb7329-0b36-496a-aea5-69f5db539b75 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:04.836979 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-eecb7329-0b36-496a-aea5-69f5db539b75 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.245158 Jun 20 14:53:04.840859 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 61/132] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:04 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:05.026931 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-718210c0-de0c-4b61-a590-52dfe8b3fd91 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:05.027500 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-718210c0-de0c-4b61-a590-52dfe8b3fd91 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:05.033791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-718210c0-de0c-4b61-a590-52dfe8b3fd91 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:05.034242 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-718210c0-de0c-4b61-a590-52dfe8b3fd91 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:05.035004 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-718210c0-de0c-4b61-a590-52dfe8b3fd91 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:05.035435 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-718210c0-de0c-4b61-a590-52dfe8b3fd91 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:05.104449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-718210c0-de0c-4b61-a590-52dfe8b3fd91 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:05.112454 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-718210c0-de0c-4b61-a590-52dfe8b3fd91 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1272 microversion: 2.1 time: 0.090315 Jun 20 14:53:05.113062 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 72/133] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:05 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:05.854513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2005fb7c-1ff3-4d38-9bc8-8e63a36a8c90 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:05.855212 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2005fb7c-1ff3-4d38-9bc8-8e63a36a8c90 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:05.862073 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2005fb7c-1ff3-4d38-9bc8-8e63a36a8c90 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:05.862524 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2005fb7c-1ff3-4d38-9bc8-8e63a36a8c90 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:05.863280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2005fb7c-1ff3-4d38-9bc8-8e63a36a8c90 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:05.863718 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2005fb7c-1ff3-4d38-9bc8-8e63a36a8c90 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:06.004366 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2005fb7c-1ff3-4d38-9bc8-8e63a36a8c90 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:06.013219 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2005fb7c-1ff3-4d38-9bc8-8e63a36a8c90 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.162917 Jun 20 14:53:06.013762 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 62/134] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:05 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:06.133211 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-18662f4c-0a66-4e32-9588-21251bfead65 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:06.133903 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-18662f4c-0a66-4e32-9588-21251bfead65 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:06.141089 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-18662f4c-0a66-4e32-9588-21251bfead65 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:06.141540 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-18662f4c-0a66-4e32-9588-21251bfead65 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:06.142276 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-18662f4c-0a66-4e32-9588-21251bfead65 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:06.142699 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-18662f4c-0a66-4e32-9588-21251bfead65 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:06.206060 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-18662f4c-0a66-4e32-9588-21251bfead65 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:06.213792 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-18662f4c-0a66-4e32-9588-21251bfead65 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1272 microversion: 2.1 time: 0.086606 Jun 20 14:53:06.214355 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 73/135] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:06 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:07.032231 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2b364785-592f-4d52-8794-c567792d0fdc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:07.033370 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2b364785-592f-4d52-8794-c567792d0fdc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:07.040305 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2b364785-592f-4d52-8794-c567792d0fdc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:07.040747 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2b364785-592f-4d52-8794-c567792d0fdc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:07.041535 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2b364785-592f-4d52-8794-c567792d0fdc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:07.041966 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2b364785-592f-4d52-8794-c567792d0fdc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:07.185027 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2b364785-592f-4d52-8794-c567792d0fdc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:07.193202 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2b364785-592f-4d52-8794-c567792d0fdc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.165136 Jun 20 14:53:07.193879 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 63/136] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:07 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:07.234381 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ba5d868a-10bd-49f0-b6d7-3dd2b5880924 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:07.234897 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ba5d868a-10bd-49f0-b6d7-3dd2b5880924 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:07.243253 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba5d868a-10bd-49f0-b6d7-3dd2b5880924 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:07.243692 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba5d868a-10bd-49f0-b6d7-3dd2b5880924 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:07.244440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba5d868a-10bd-49f0-b6d7-3dd2b5880924 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:07.244905 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba5d868a-10bd-49f0-b6d7-3dd2b5880924 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:07.312505 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ba5d868a-10bd-49f0-b6d7-3dd2b5880924 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:07.320571 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ba5d868a-10bd-49f0-b6d7-3dd2b5880924 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1272 microversion: 2.1 time: 0.092474 Jun 20 14:53:07.321177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 74/137] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:07 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:08.210644 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e93901b6-36d7-4285-9aa8-6e82275e92a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:08.211867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e93901b6-36d7-4285-9aa8-6e82275e92a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:08.218897 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e93901b6-36d7-4285-9aa8-6e82275e92a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:08.219337 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e93901b6-36d7-4285-9aa8-6e82275e92a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:08.220080 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e93901b6-36d7-4285-9aa8-6e82275e92a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:08.220543 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e93901b6-36d7-4285-9aa8-6e82275e92a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:08.338912 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-a0a89606-1320-4fc8-98f8-5c39e1566220 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:08.339647 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-a0a89606-1320-4fc8-98f8-5c39e1566220 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:08.346186 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a0a89606-1320-4fc8-98f8-5c39e1566220 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:08.346706 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a0a89606-1320-4fc8-98f8-5c39e1566220 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:08.347536 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a0a89606-1320-4fc8-98f8-5c39e1566220 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:08.348032 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a0a89606-1320-4fc8-98f8-5c39e1566220 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:08.414434 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-e93901b6-36d7-4285-9aa8-6e82275e92a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:08.425054 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e93901b6-36d7-4285-9aa8-6e82275e92a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.218328 Jun 20 14:53:08.425894 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 64/138] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:08 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:08.435152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a0a89606-1320-4fc8-98f8-5c39e1566220 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:08.444432 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-a0a89606-1320-4fc8-98f8-5c39e1566220 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1272 microversion: 2.1 time: 0.110873 Jun 20 14:53:08.445000 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 75/139] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:08 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:53:09.444687 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-5b6c681a-c892-4589-b9eb-6ea64b8ac8e1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:09.446790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-5b6c681a-c892-4589-b9eb-6ea64b8ac8e1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:09.453533 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5b6c681a-c892-4589-b9eb-6ea64b8ac8e1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:09.454296 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5b6c681a-c892-4589-b9eb-6ea64b8ac8e1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:09.455441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5b6c681a-c892-4589-b9eb-6ea64b8ac8e1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:09.455878 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5b6c681a-c892-4589-b9eb-6ea64b8ac8e1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:09.461375 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-4e38e1ab-4882-4f4d-bb5f-66ffa904293f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:09.462132 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-4e38e1ab-4882-4f4d-bb5f-66ffa904293f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:09.469040 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4e38e1ab-4882-4f4d-bb5f-66ffa904293f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:09.469486 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4e38e1ab-4882-4f4d-bb5f-66ffa904293f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:09.470251 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4e38e1ab-4882-4f4d-bb5f-66ffa904293f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:09.470706 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4e38e1ab-4882-4f4d-bb5f-66ffa904293f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:09.488756 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:09.605784 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-5b6c681a-c892-4589-b9eb-6ea64b8ac8e1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:09.614553 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-5b6c681a-c892-4589-b9eb-6ea64b8ac8e1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.175554 Jun 20 14:53:09.615321 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 65/140] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:09 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:09.642321 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-4e38e1ab-4882-4f4d-bb5f-66ffa904293f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:09.650732 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-4e38e1ab-4882-4f4d-bb5f-66ffa904293f tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1314 microversion: 2.1 time: 0.193162 Jun 20 14:53:09.651308 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 76/141] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:09 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:10.633256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c9ecf495-c88b-40c9-8925-67e1b1942fa2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:10.633836 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-c9ecf495-c88b-40c9-8925-67e1b1942fa2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:10.640926 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c9ecf495-c88b-40c9-8925-67e1b1942fa2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:10.641375 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c9ecf495-c88b-40c9-8925-67e1b1942fa2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:10.642154 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c9ecf495-c88b-40c9-8925-67e1b1942fa2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:10.642586 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c9ecf495-c88b-40c9-8925-67e1b1942fa2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:10.668015 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-09807e6c-0538-40e3-9a79-18bdf24107da tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:10.668604 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-09807e6c-0538-40e3-9a79-18bdf24107da tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:10.675425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-09807e6c-0538-40e3-9a79-18bdf24107da tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:10.675863 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-09807e6c-0538-40e3-9a79-18bdf24107da tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:10.676614 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-09807e6c-0538-40e3-9a79-18bdf24107da tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:10.677035 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-09807e6c-0538-40e3-9a79-18bdf24107da tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:10.779718 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-c9ecf495-c88b-40c9-8925-67e1b1942fa2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:10.789771 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-c9ecf495-c88b-40c9-8925-67e1b1942fa2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.160950 Jun 20 14:53:10.789961 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 66/142] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:10 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:10.810274 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-09807e6c-0538-40e3-9a79-18bdf24107da tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:10.818672 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-09807e6c-0538-40e3-9a79-18bdf24107da tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1314 microversion: 2.1 time: 0.154379 Jun 20 14:53:10.819232 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 77/143] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:10 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:11.806955 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d7c29a17-37ac-44e0-9acb-aecb35362c88 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:11.807540 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-d7c29a17-37ac-44e0-9acb-aecb35362c88 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:11.809536 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:11.810785 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=6 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:11.817612 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d7c29a17-37ac-44e0-9acb-aecb35362c88 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:11.818052 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d7c29a17-37ac-44e0-9acb-aecb35362c88 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:11.819068 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d7c29a17-37ac-44e0-9acb-aecb35362c88 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:11.819469 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d7c29a17-37ac-44e0-9acb-aecb35362c88 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:11.836372 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3834ceaa-e160-4a44-ade9-19040b64139d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:11.837016 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3834ceaa-e160-4a44-ade9-19040b64139d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:11.840146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:11.840739 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=70 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:11.846012 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3834ceaa-e160-4a44-ade9-19040b64139d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:11.846472 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3834ceaa-e160-4a44-ade9-19040b64139d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:11.847219 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3834ceaa-e160-4a44-ade9-19040b64139d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:11.847644 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3834ceaa-e160-4a44-ade9-19040b64139d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:11.963600 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d7c29a17-37ac-44e0-9acb-aecb35362c88 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:11.974482 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d7c29a17-37ac-44e0-9acb-aecb35362c88 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.171706 Jun 20 14:53:11.986296 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 67/144] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:11 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:12.011326 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3834ceaa-e160-4a44-ade9-19040b64139d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:12.020615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3834ceaa-e160-4a44-ade9-19040b64139d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1314 microversion: 2.1 time: 0.188506 Jun 20 14:53:12.029488 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 78/145] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:11 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:12.994869 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b7ed2b14-e955-40f3-841d-f39c51db77a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:12.996511 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-b7ed2b14-e955-40f3-841d-f39c51db77a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:13.004508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:13.019183 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b7ed2b14-e955-40f3-841d-f39c51db77a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:13.019183 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b7ed2b14-e955-40f3-841d-f39c51db77a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:13.027656 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b7ed2b14-e955-40f3-841d-f39c51db77a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:13.028610 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b7ed2b14-e955-40f3-841d-f39c51db77a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:13.067169 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-c3de5221-09c5-4402-8c65-e6ebfb0dc5e6 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:13.068280 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-c3de5221-09c5-4402-8c65-e6ebfb0dc5e6 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:13.081205 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c3de5221-09c5-4402-8c65-e6ebfb0dc5e6 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:13.081649 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c3de5221-09c5-4402-8c65-e6ebfb0dc5e6 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:13.083506 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c3de5221-09c5-4402-8c65-e6ebfb0dc5e6 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:13.084293 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c3de5221-09c5-4402-8c65-e6ebfb0dc5e6 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:13.333087 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-b7ed2b14-e955-40f3-841d-f39c51db77a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:13.353100 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b7ed2b14-e955-40f3-841d-f39c51db77a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.363493 Jun 20 14:53:13.355810 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 68/146] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:12 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:13.369489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-db4c7bb3-1532-4f6e-a662-a434d752dc2b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:13.370182 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-db4c7bb3-1532-4f6e-a662-a434d752dc2b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:13.371130 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-c3de5221-09c5-4402-8c65-e6ebfb0dc5e6 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:13.376504 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-db4c7bb3-1532-4f6e-a662-a434d752dc2b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:13.376993 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-db4c7bb3-1532-4f6e-a662-a434d752dc2b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:13.377936 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-db4c7bb3-1532-4f6e-a662-a434d752dc2b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:13.379807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-db4c7bb3-1532-4f6e-a662-a434d752dc2b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:13.381932 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-c3de5221-09c5-4402-8c65-e6ebfb0dc5e6 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1314 microversion: 2.1 time: 0.346764 Jun 20 14:53:13.391238 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 79/147] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:13 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:13.406678 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-db4c7bb3-1532-4f6e-a662-a434d752dc2b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 14:53:13.465103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:13.516468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-efdb0e6f-fed8-4dab-8596-8736edffb5fb req-54e0086b-bf5c-4271-a858-cf2bb5049e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "407a64e8-ef64-49c1-9942-c1a455e8fef5", "tag": "8d85ac9c-976c-4ea9-976b-b8bd72d48a2f"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:53:13.532308 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-db4c7bb3-1532-4f6e-a662-a434d752dc2b tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 204 len: 0 microversion: 2.1 time: 0.172322 Jun 20 14:53:13.532908 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-efdb0e6f-fed8-4dab-8596-8736edffb5fb req-54e0086b-bf5c-4271-a858-cf2bb5049e30 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:13.533382 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 69/148] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:53:13 2022] DELETE /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:53:13.547423 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3910dece-7407-46b7-b99f-f488689afcb8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:13.549808 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-3910dece-7407-46b7-b99f-f488689afcb8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:13.551516 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-efdb0e6f-fed8-4dab-8596-8736edffb5fb req-54e0086b-bf5c-4271-a858-cf2bb5049e30 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:13.558147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3910dece-7407-46b7-b99f-f488689afcb8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:13.559201 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3910dece-7407-46b7-b99f-f488689afcb8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:13.561278 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3910dece-7407-46b7-b99f-f488689afcb8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:13.576331 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3910dece-7407-46b7-b99f-f488689afcb8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:13.578864 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-efdb0e6f-fed8-4dab-8596-8736edffb5fb req-54e0086b-bf5c-4271-a858-cf2bb5049e30 service nova] Creating event network-changed:8d85ac9c-976c-4ea9-976b-b8bd72d48a2f for instance 407a64e8-ef64-49c1-9942-c1a455e8fef5 on hv-cinder-83697 Jun 20 14:53:13.584259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-efdb0e6f-fed8-4dab-8596-8736edffb5fb req-54e0086b-bf5c-4271-a858-cf2bb5049e30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071496 Jun 20 14:53:13.584893 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 80/149] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 14:53:13.713712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3910dece-7407-46b7-b99f-f488689afcb8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:13.722088 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-3910dece-7407-46b7-b99f-f488689afcb8 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1552 microversion: 2.1 time: 0.183774 Jun 20 14:53:13.722634 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 70/150] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:13 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1552 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:14.373681 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ca505f69-c53f-41d9-8777-b467a0dceeb1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:14.375082 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ca505f69-c53f-41d9-8777-b467a0dceeb1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:14.387020 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ca505f69-c53f-41d9-8777-b467a0dceeb1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:14.387527 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ca505f69-c53f-41d9-8777-b467a0dceeb1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:14.388374 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ca505f69-c53f-41d9-8777-b467a0dceeb1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:14.388830 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ca505f69-c53f-41d9-8777-b467a0dceeb1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:14.399770 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1841b39a-078e-4611-9ea7-549eeec5459c tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:14.400454 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1841b39a-078e-4611-9ea7-549eeec5459c tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:14.407387 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1841b39a-078e-4611-9ea7-549eeec5459c tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:14.407941 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1841b39a-078e-4611-9ea7-549eeec5459c tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:14.409624 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1841b39a-078e-4611-9ea7-549eeec5459c tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:14.409624 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1841b39a-078e-4611-9ea7-549eeec5459c tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:14.525372 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ca505f69-c53f-41d9-8777-b467a0dceeb1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:14.537121 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ca505f69-c53f-41d9-8777-b467a0dceeb1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.168706 Jun 20 14:53:14.538216 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 81/151] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:14 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:14.626547 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1841b39a-078e-4611-9ea7-549eeec5459c tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:14.637205 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1841b39a-078e-4611-9ea7-549eeec5459c tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1314 microversion: 2.1 time: 0.241158 Jun 20 14:53:14.648495 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 71/152] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:14 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:53:14.738984 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-be59c917-d924-40f8-a6ce-72a62d3863cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:14.739586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-be59c917-d924-40f8-a6ce-72a62d3863cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:14.745914 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-be59c917-d924-40f8-a6ce-72a62d3863cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:14.746299 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-be59c917-d924-40f8-a6ce-72a62d3863cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:14.752403 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-be59c917-d924-40f8-a6ce-72a62d3863cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:14.753077 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-be59c917-d924-40f8-a6ce-72a62d3863cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:14.910523 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-be59c917-d924-40f8-a6ce-72a62d3863cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:14.929998 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-be59c917-d924-40f8-a6ce-72a62d3863cc tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1552 microversion: 2.1 time: 0.193667 Jun 20 14:53:14.932377 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 82/153] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:14 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1552 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:15.554855 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c8e47900-b684-48ff-854a-48901c119894 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:15.555416 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-c8e47900-b684-48ff-854a-48901c119894 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:15.575143 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c8e47900-b684-48ff-854a-48901c119894 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:15.575782 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c8e47900-b684-48ff-854a-48901c119894 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:15.576764 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c8e47900-b684-48ff-854a-48901c119894 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:15.577679 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c8e47900-b684-48ff-854a-48901c119894 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:15.663529 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-cba908fd-d5ce-4b98-aac8-e6b80c025bc2 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:15.665249 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-cba908fd-d5ce-4b98-aac8-e6b80c025bc2 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:15.678902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cba908fd-d5ce-4b98-aac8-e6b80c025bc2 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:15.679956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cba908fd-d5ce-4b98-aac8-e6b80c025bc2 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:15.681384 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cba908fd-d5ce-4b98-aac8-e6b80c025bc2 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:15.682334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cba908fd-d5ce-4b98-aac8-e6b80c025bc2 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:15.792233 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-c8e47900-b684-48ff-854a-48901c119894 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:15.801023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-c8e47900-b684-48ff-854a-48901c119894 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.251135 Jun 20 14:53:15.802074 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 72/154] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:15 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:15.902189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-cba908fd-d5ce-4b98-aac8-e6b80c025bc2 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:15.910412 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-cba908fd-d5ce-4b98-aac8-e6b80c025bc2 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1314 microversion: 2.1 time: 0.256079 Jun 20 14:53:15.911090 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 83/155] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:15 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:15.957522 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-af818c32-b147-45f3-bdcd-a559a919f33e tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:15.958337 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-af818c32-b147-45f3-bdcd-a559a919f33e tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:15.973483 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-af818c32-b147-45f3-bdcd-a559a919f33e tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:15.973932 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-af818c32-b147-45f3-bdcd-a559a919f33e tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:15.975215 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-af818c32-b147-45f3-bdcd-a559a919f33e tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:15.975796 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-af818c32-b147-45f3-bdcd-a559a919f33e tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:16.308802 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-af818c32-b147-45f3-bdcd-a559a919f33e tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:16.320032 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-af818c32-b147-45f3-bdcd-a559a919f33e tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1552 microversion: 2.1 time: 0.374636 Jun 20 14:53:16.321102 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 73/156] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:15 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1552 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:16.818999 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-66d383b4-6ed9-478a-bcb7-e9263e82edfe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:16.820158 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-66d383b4-6ed9-478a-bcb7-e9263e82edfe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:16.825682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-66d383b4-6ed9-478a-bcb7-e9263e82edfe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:16.826117 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-66d383b4-6ed9-478a-bcb7-e9263e82edfe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:16.826875 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-66d383b4-6ed9-478a-bcb7-e9263e82edfe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:16.827321 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-66d383b4-6ed9-478a-bcb7-e9263e82edfe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:16.940833 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-a1e30f0e-11fe-4b4f-919c-9f9cdb2312c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:16.942671 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-a1e30f0e-11fe-4b4f-919c-9f9cdb2312c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:16.951182 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a1e30f0e-11fe-4b4f-919c-9f9cdb2312c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:16.951635 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a1e30f0e-11fe-4b4f-919c-9f9cdb2312c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:16.952608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a1e30f0e-11fe-4b4f-919c-9f9cdb2312c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:16.953063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a1e30f0e-11fe-4b4f-919c-9f9cdb2312c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:17.104669 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-66d383b4-6ed9-478a-bcb7-e9263e82edfe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:17.114617 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-66d383b4-6ed9-478a-bcb7-e9263e82edfe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.299522 Jun 20 14:53:17.116191 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 84/157] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:16 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:17.176106 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-a1e30f0e-11fe-4b4f-919c-9f9cdb2312c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:17.187432 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-a1e30f0e-11fe-4b4f-919c-9f9cdb2312c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1314 microversion: 2.1 time: 0.261404 Jun 20 14:53:17.189247 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 74/158] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:16 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:17.336816 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b42e2e38-28d1-4ed8-add4-c990b5a35e72 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:17.337423 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-b42e2e38-28d1-4ed8-add4-c990b5a35e72 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:17.346775 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b42e2e38-28d1-4ed8-add4-c990b5a35e72 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:17.346972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b42e2e38-28d1-4ed8-add4-c990b5a35e72 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:17.356268 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b42e2e38-28d1-4ed8-add4-c990b5a35e72 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:17.357075 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b42e2e38-28d1-4ed8-add4-c990b5a35e72 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:17.489601 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-95686a7f-8806-4fdc-925a-55e6f9967262 req-17ab54f5-ab50-4758-b30c-bf28d002cdc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4eeab20-5dea-4424-9945-640e8f24f6b0", "name": "network-vif-deleted", "tag": "f217b1ab-0950-4d40-a487-def66c16ac43"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:53:17.501733 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-95686a7f-8806-4fdc-925a-55e6f9967262 req-17ab54f5-ab50-4758-b30c-bf28d002cdc0 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:17.502164 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-95686a7f-8806-4fdc-925a-55e6f9967262 req-17ab54f5-ab50-4758-b30c-bf28d002cdc0 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:17.505275 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-b42e2e38-28d1-4ed8-add4-c990b5a35e72 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:17.521905 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-95686a7f-8806-4fdc-925a-55e6f9967262 req-17ab54f5-ab50-4758-b30c-bf28d002cdc0 service nova] Creating event network-vif-deleted:f217b1ab-0950-4d40-a487-def66c16ac43 for instance a4eeab20-5dea-4424-9945-640e8f24f6b0 on hv-cinder-83697 Jun 20 14:53:17.527701 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-95686a7f-8806-4fdc-925a-55e6f9967262 req-17ab54f5-ab50-4758-b30c-bf28d002cdc0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041773 Jun 20 14:53:17.527893 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-b42e2e38-28d1-4ed8-add4-c990b5a35e72 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1510 microversion: 2.1 time: 0.194705 Jun 20 14:53:17.528305 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 75/159] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 14:53:17.531128 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 85/160] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:17 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:18.133494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-dfe73a95-53a0-496a-aef4-c589f1ba05a3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:18.134280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-dfe73a95-53a0-496a-aef4-c589f1ba05a3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:18.146068 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dfe73a95-53a0-496a-aef4-c589f1ba05a3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:18.148647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dfe73a95-53a0-496a-aef4-c589f1ba05a3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:18.149580 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dfe73a95-53a0-496a-aef4-c589f1ba05a3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:18.150082 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dfe73a95-53a0-496a-aef4-c589f1ba05a3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:18.206765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3d332791-9854-492d-9aeb-650ffe060b8b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:18.207921 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3d332791-9854-492d-9aeb-650ffe060b8b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:18.221711 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3d332791-9854-492d-9aeb-650ffe060b8b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:18.225328 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3d332791-9854-492d-9aeb-650ffe060b8b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:18.226425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3d332791-9854-492d-9aeb-650ffe060b8b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:18.227310 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3d332791-9854-492d-9aeb-650ffe060b8b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:18.449681 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-dfe73a95-53a0-496a-aef4-c589f1ba05a3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:18.461256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-dfe73a95-53a0-496a-aef4-c589f1ba05a3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.332761 Jun 20 14:53:18.468860 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 76/161] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:18 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:18.469166 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3d332791-9854-492d-9aeb-650ffe060b8b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:18.475695 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3d332791-9854-492d-9aeb-650ffe060b8b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1314 microversion: 2.1 time: 0.274131 Jun 20 14:53:18.476405 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 86/162] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:18 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:18.546022 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-de0ffd0c-c36f-4a93-9795-d78becccbfa6 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:18.546993 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-de0ffd0c-c36f-4a93-9795-d78becccbfa6 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:18.553558 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-de0ffd0c-c36f-4a93-9795-d78becccbfa6 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:18.554210 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-de0ffd0c-c36f-4a93-9795-d78becccbfa6 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:18.554981 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-de0ffd0c-c36f-4a93-9795-d78becccbfa6 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:18.555402 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-de0ffd0c-c36f-4a93-9795-d78becccbfa6 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:18.598364 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-de0ffd0c-c36f-4a93-9795-d78becccbfa6 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:18.600422 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-de0ffd0c-c36f-4a93-9795-d78becccbfa6 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:18.600936 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-de0ffd0c-c36f-4a93-9795-d78becccbfa6 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lazy-loading 'fault' on Instance uuid a4eeab20-5dea-4424-9945-640e8f24f6b0 {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:53:18.655308 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-de0ffd0c-c36f-4a93-9795-d78becccbfa6 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:18.663502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-de0ffd0c-c36f-4a93-9795-d78becccbfa6 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1350 microversion: 2.1 time: 0.121290 Jun 20 14:53:18.664085 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 77/163] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:18 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1350 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:19.478643 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3d030dea-eae1-4b1e-b54b-ff38a34994d3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:19.479227 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3d030dea-eae1-4b1e-b54b-ff38a34994d3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:19.485522 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3d030dea-eae1-4b1e-b54b-ff38a34994d3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:19.485959 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3d030dea-eae1-4b1e-b54b-ff38a34994d3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:19.486864 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3d030dea-eae1-4b1e-b54b-ff38a34994d3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:19.487414 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3d030dea-eae1-4b1e-b54b-ff38a34994d3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:19.493288 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-872709d6-889e-4b22-8d79-a217a2056ab5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:19.494497 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-872709d6-889e-4b22-8d79-a217a2056ab5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:19.502564 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-872709d6-889e-4b22-8d79-a217a2056ab5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:19.503163 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-872709d6-889e-4b22-8d79-a217a2056ab5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:19.504077 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-872709d6-889e-4b22-8d79-a217a2056ab5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:19.504510 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-872709d6-889e-4b22-8d79-a217a2056ab5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:19.678896 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3d030dea-eae1-4b1e-b54b-ff38a34994d3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:19.698543 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3d030dea-eae1-4b1e-b54b-ff38a34994d3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.215286 Jun 20 14:53:19.699428 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 87/164] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:19 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:19.702965 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-872709d6-889e-4b22-8d79-a217a2056ab5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:19.713047 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-872709d6-889e-4b22-8d79-a217a2056ab5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1314 microversion: 2.1 time: 0.224255 Jun 20 14:53:19.713932 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 78/165] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:19 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:19.716434 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1914e4f5-525c-4d3d-9ad8-d795134f4b3d tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:19.717957 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-1914e4f5-525c-4d3d-9ad8-d795134f4b3d tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:19.724785 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1914e4f5-525c-4d3d-9ad8-d795134f4b3d tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:19.725422 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1914e4f5-525c-4d3d-9ad8-d795134f4b3d tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:19.726353 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1914e4f5-525c-4d3d-9ad8-d795134f4b3d tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:19.726773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1914e4f5-525c-4d3d-9ad8-d795134f4b3d tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:19.765721 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1914e4f5-525c-4d3d-9ad8-d795134f4b3d tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:19.766158 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1914e4f5-525c-4d3d-9ad8-d795134f4b3d tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:19.766597 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.objects.instance [None req-1914e4f5-525c-4d3d-9ad8-d795134f4b3d tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lazy-loading 'fault' on Instance uuid a4eeab20-5dea-4424-9945-640e8f24f6b0 {{(pid=123979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:53:19.820631 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-1914e4f5-525c-4d3d-9ad8-d795134f4b3d tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:19.828911 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1914e4f5-525c-4d3d-9ad8-d795134f4b3d tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1350 microversion: 2.1 time: 0.121883 Jun 20 14:53:19.829595 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 88/166] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:19 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:20.720271 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2e515d4b-1d02-48d7-b22e-46c164a85e17 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:20.721226 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2e515d4b-1d02-48d7-b22e-46c164a85e17 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:20.729588 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2e515d4b-1d02-48d7-b22e-46c164a85e17 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:20.729953 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2e515d4b-1d02-48d7-b22e-46c164a85e17 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:20.730712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2e515d4b-1d02-48d7-b22e-46c164a85e17 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:20.730866 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-c16fb037-00e8-4696-af04-beb134d4c8eb tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:20.731286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2e515d4b-1d02-48d7-b22e-46c164a85e17 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:20.731383 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-c16fb037-00e8-4696-af04-beb134d4c8eb tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:20.738008 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c16fb037-00e8-4696-af04-beb134d4c8eb tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:20.738323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c16fb037-00e8-4696-af04-beb134d4c8eb tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:20.739089 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c16fb037-00e8-4696-af04-beb134d4c8eb tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:20.739505 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c16fb037-00e8-4696-af04-beb134d4c8eb tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:20.866901 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2e515d4b-1d02-48d7-b22e-46c164a85e17 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:20.874341 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-c16fb037-00e8-4696-af04-beb134d4c8eb tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:20.874721 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2e515d4b-1d02-48d7-b22e-46c164a85e17 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.160891 Jun 20 14:53:20.875304 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 79/167] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:20 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:20.885377 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-464de34c-ed79-477e-b525-6440e984fba5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:20.885377 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-464de34c-ed79-477e-b525-6440e984fba5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:20.885621 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-c16fb037-00e8-4696-af04-beb134d4c8eb tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1314 microversion: 2.1 time: 0.155066 Jun 20 14:53:20.885621 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 89/168] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:20 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:20.886538 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-464de34c-ed79-477e-b525-6440e984fba5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:20.886974 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-464de34c-ed79-477e-b525-6440e984fba5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:20.887732 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-464de34c-ed79-477e-b525-6440e984fba5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:20.888158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-464de34c-ed79-477e-b525-6440e984fba5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:20.919331 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-464de34c-ed79-477e-b525-6440e984fba5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:20.919770 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-464de34c-ed79-477e-b525-6440e984fba5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:20.920204 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-464de34c-ed79-477e-b525-6440e984fba5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lazy-loading 'fault' on Instance uuid a4eeab20-5dea-4424-9945-640e8f24f6b0 {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:53:20.962724 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-464de34c-ed79-477e-b525-6440e984fba5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ebe0d05a1c4b66aa3b3abebd0ce026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361bd83b835c4ec3b01a1173b2d9cb1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:20.975296 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-464de34c-ed79-477e-b525-6440e984fba5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 200 len: 1350 microversion: 2.1 time: 0.098914 Jun 20 14:53:20.976202 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 80/169] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:20 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:21.756688 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-698e139d-c0b5-4832-b55d-954588631643 req-1fdebc27-fd14-4fc5-b6c4-5bd7d0922b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407a64e8-ef64-49c1-9942-c1a455e8fef5", "name": "network-vif-plugged", "status": "completed", "tag": "8d85ac9c-976c-4ea9-976b-b8bd72d48a2f"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:53:21.767115 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-698e139d-c0b5-4832-b55d-954588631643 req-1fdebc27-fd14-4fc5-b6c4-5bd7d0922b8a service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:21.767721 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-698e139d-c0b5-4832-b55d-954588631643 req-1fdebc27-fd14-4fc5-b6c4-5bd7d0922b8a service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:21.781187 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-698e139d-c0b5-4832-b55d-954588631643 req-1fdebc27-fd14-4fc5-b6c4-5bd7d0922b8a service nova] Creating event network-vif-plugged:8d85ac9c-976c-4ea9-976b-b8bd72d48a2f for instance 407a64e8-ef64-49c1-9942-c1a455e8fef5 on hv-cinder-83697 Jun 20 14:53:21.786934 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-698e139d-c0b5-4832-b55d-954588631643 req-1fdebc27-fd14-4fc5-b6c4-5bd7d0922b8a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034638 Jun 20 14:53:21.787562 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 90/170] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:53:21.893724 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-4e15a352-5852-45a6-bd0b-36db72741edd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:21.894943 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-4e15a352-5852-45a6-bd0b-36db72741edd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:21.901117 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3a52042e-2467-4c41-b6c6-1d6541ea07e5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:21.902066 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e15a352-5852-45a6-bd0b-36db72741edd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:21.902415 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3a52042e-2467-4c41-b6c6-1d6541ea07e5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:21.902595 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e15a352-5852-45a6-bd0b-36db72741edd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:21.903425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e15a352-5852-45a6-bd0b-36db72741edd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:21.904302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e15a352-5852-45a6-bd0b-36db72741edd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:21.912507 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3a52042e-2467-4c41-b6c6-1d6541ea07e5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:21.913064 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3a52042e-2467-4c41-b6c6-1d6541ea07e5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:21.913886 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3a52042e-2467-4c41-b6c6-1d6541ea07e5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:21.914500 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3a52042e-2467-4c41-b6c6-1d6541ea07e5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:22.046638 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-4e15a352-5852-45a6-bd0b-36db72741edd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:22.054738 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-4e15a352-5852-45a6-bd0b-36db72741edd tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.165565 Jun 20 14:53:22.055360 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 81/171] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:21 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:22.059841 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-9c017f24-5582-441a-bb53-04979dc0de25 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:22.060566 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-9c017f24-5582-441a-bb53-04979dc0de25 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:22.066745 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9c017f24-5582-441a-bb53-04979dc0de25 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:22.067113 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9c017f24-5582-441a-bb53-04979dc0de25 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:22.067869 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9c017f24-5582-441a-bb53-04979dc0de25 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:22.068419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9c017f24-5582-441a-bb53-04979dc0de25 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:22.081715 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-9c017f24-5582-441a-bb53-04979dc0de25 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] HTTP exception thrown: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-9c017f24-5582-441a-bb53-04979dc0de25 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Request method failure captured: Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 HTTP/1.1 Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImj1_-0FTWTTgA196M9cho2a2oNkhrMn51-Yq0et8DPVd1fSTzDEgNAFqbSV3QO0LzJKvTjRpSq4Ndaih8U1WMtYV2saNtb4KsNacGdC0d51t_JjDY8wf26hQjJzoo_-vjlHBsyKbATnPKgnMSGhxcDndMIp0saPeMccJxARenRCoc Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: 361bd83b835c4ec3b01a1173b2d9cb1d Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-DeleteServersTestJSON-791467553 Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:53:22.093727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:53:22.095258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_361bd83b835c4ec3b01a1173b2d9cb1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/361bd83b835c4ec3b01a1173b2d9cb1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/361bd83b835c4ec3b01a1173b2d9cb1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/361bd83b835c4ec3b01a1173b2d9cb1d"}]}] Jun 20 14:53:22.095258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-DeleteServersTestJSON-791467553 Jun 20 14:53:22.095258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: 361bd83b835c4ec3b01a1173b2d9cb1d Jun 20 14:53:22.095258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-DeleteServersTestJSON-791467553 Jun 20 14:53:22.095258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-DeleteServersTestJSON-791467553-project Jun 20 14:53:22.095258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:53:22.095258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:53:22.095258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 75ebe0d05a1c4b66aa3b3abebd0ce026 Jun 20 14:53:22.095258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-DeleteServersTestJSON-791467553-project Jun 20 14:53:22.095258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:53:22.095258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:22.095258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': 'a4eeab20-5dea-4424-9945-640e8f24f6b0'} Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:53:22.096017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:22.097254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:53:22.098428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-9c017f24-5582-441a-bb53-04979dc0de25 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Returning 404 to user: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:53:22.098428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-9c017f24-5582-441a-bb53-04979dc0de25 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 404 len: 111 microversion: 2.1 time: 0.039746 Jun 20 14:53:22.098428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 82/172] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:22 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:53:22.112842 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3a52042e-2467-4c41-b6c6-1d6541ea07e5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:22.120622 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3a52042e-2467-4c41-b6c6-1d6541ea07e5 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1314 microversion: 2.1 time: 0.225265 Jun 20 14:53:22.121513 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 91/173] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:21 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:22.204391 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-82be6087-888c-4556-a765-5887f7925660 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:22.205399 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-82be6087-888c-4556-a765-5887f7925660 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:22.211679 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-82be6087-888c-4556-a765-5887f7925660 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:22.212117 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-82be6087-888c-4556-a765-5887f7925660 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:22.212898 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-82be6087-888c-4556-a765-5887f7925660 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:22.213356 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-82be6087-888c-4556-a765-5887f7925660 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:22.231114 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-82be6087-888c-4556-a765-5887f7925660 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] HTTP exception thrown: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-82be6087-888c-4556-a765-5887f7925660 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Request method failure captured: Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0/os-volume_attachments HTTP/1.1 Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImj1_-0FTWTTgA196M9cho2a2oNkhrMn51-Yq0et8DPVd1fSTzDEgNAFqbSV3QO0LzJKvTjRpSq4Ndaih8U1WMtYV2saNtb4KsNacGdC0d51t_JjDY8wf26hQjJzoo_-vjlHBsyKbATnPKgnMSGhxcDndMIp0saPeMccJxARenRCoc Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: 361bd83b835c4ec3b01a1173b2d9cb1d Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-DeleteServersTestJSON-791467553 Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:53:22.232789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:53:22.234147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_361bd83b835c4ec3b01a1173b2d9cb1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/361bd83b835c4ec3b01a1173b2d9cb1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/361bd83b835c4ec3b01a1173b2d9cb1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/361bd83b835c4ec3b01a1173b2d9cb1d"}]}] Jun 20 14:53:22.234147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-DeleteServersTestJSON-791467553 Jun 20 14:53:22.234147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: 361bd83b835c4ec3b01a1173b2d9cb1d Jun 20 14:53:22.234147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-DeleteServersTestJSON-791467553 Jun 20 14:53:22.234147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-DeleteServersTestJSON-791467553-project Jun 20 14:53:22.234147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:53:22.234147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:53:22.234147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 75ebe0d05a1c4b66aa3b3abebd0ce026 Jun 20 14:53:22.234147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-DeleteServersTestJSON-791467553-project Jun 20 14:53:22.234147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:53:22.234147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:22.234147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'server_id': 'a4eeab20-5dea-4424-9945-640e8f24f6b0'} Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:53:22.234906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:22.236134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:53:22.237437 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-82be6087-888c-4556-a765-5887f7925660 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Returning 404 to user: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:53:22.237437 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-82be6087-888c-4556-a765-5887f7925660 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033997 Jun 20 14:53:22.237437 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 83/174] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 14:53:22 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:53:23.072345 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0bcfca99-74ed-4782-a1f4-28a1c5d11329 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:23.073026 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-0bcfca99-74ed-4782-a1f4-28a1c5d11329 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:23.079334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0bcfca99-74ed-4782-a1f4-28a1c5d11329 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:23.079785 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0bcfca99-74ed-4782-a1f4-28a1c5d11329 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:23.080538 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0bcfca99-74ed-4782-a1f4-28a1c5d11329 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:23.081065 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0bcfca99-74ed-4782-a1f4-28a1c5d11329 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:23.137861 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-314c98a9-2816-41c0-9c7b-fb71e81d0f41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:23.138526 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-314c98a9-2816-41c0-9c7b-fb71e81d0f41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:23.146682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-314c98a9-2816-41c0-9c7b-fb71e81d0f41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:23.147205 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-314c98a9-2816-41c0-9c7b-fb71e81d0f41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:23.148020 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-314c98a9-2816-41c0-9c7b-fb71e81d0f41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:23.148447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-314c98a9-2816-41c0-9c7b-fb71e81d0f41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:23.225914 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0bcfca99-74ed-4782-a1f4-28a1c5d11329 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:23.233548 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0bcfca99-74ed-4782-a1f4-28a1c5d11329 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.165321 Jun 20 14:53:23.234148 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 92/175] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:23 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:23.285605 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-314c98a9-2816-41c0-9c7b-fb71e81d0f41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:23.293907 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-314c98a9-2816-41c0-9c7b-fb71e81d0f41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1314 microversion: 2.1 time: 0.160087 Jun 20 14:53:23.294481 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 84/176] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:23 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:23.437013 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-049f0351-8d56-45d2-9c94-6cc53e652608 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:23.437495 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-049f0351-8d56-45d2-9c94-6cc53e652608 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:23.444553 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-049f0351-8d56-45d2-9c94-6cc53e652608 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:23.445017 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-049f0351-8d56-45d2-9c94-6cc53e652608 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:23.445763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-049f0351-8d56-45d2-9c94-6cc53e652608 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:23.446167 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-049f0351-8d56-45d2-9c94-6cc53e652608 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:23.461892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-049f0351-8d56-45d2-9c94-6cc53e652608 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] HTTP exception thrown: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-049f0351-8d56-45d2-9c94-6cc53e652608 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Request method failure captured: Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: DELETE /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 HTTP/1.1 Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImj1_-0FTWTTgA196M9cho2a2oNkhrMn51-Yq0et8DPVd1fSTzDEgNAFqbSV3QO0LzJKvTjRpSq4Ndaih8U1WMtYV2saNtb4KsNacGdC0d51t_JjDY8wf26hQjJzoo_-vjlHBsyKbATnPKgnMSGhxcDndMIp0saPeMccJxARenRCoc Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: 361bd83b835c4ec3b01a1173b2d9cb1d Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-DeleteServersTestJSON-791467553 Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:53:23.466449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:53:23.467821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_361bd83b835c4ec3b01a1173b2d9cb1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/361bd83b835c4ec3b01a1173b2d9cb1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/361bd83b835c4ec3b01a1173b2d9cb1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/361bd83b835c4ec3b01a1173b2d9cb1d"}]}] Jun 20 14:53:23.467821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-DeleteServersTestJSON-791467553 Jun 20 14:53:23.467821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: 361bd83b835c4ec3b01a1173b2d9cb1d Jun 20 14:53:23.467821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-DeleteServersTestJSON-791467553 Jun 20 14:53:23.467821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-DeleteServersTestJSON-791467553-project Jun 20 14:53:23.467821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:53:23.467821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:53:23.467821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 75ebe0d05a1c4b66aa3b3abebd0ce026 Jun 20 14:53:23.467821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-DeleteServersTestJSON-791467553-project Jun 20 14:53:23.467821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:53:23.467821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:23.467821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': 'a4eeab20-5dea-4424-9945-640e8f24f6b0'} Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:53:23.468559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:23.469865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:53:23.471134 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-049f0351-8d56-45d2-9c94-6cc53e652608 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Returning 404 to user: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:53:23.471134 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-049f0351-8d56-45d2-9c94-6cc53e652608 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 404 len: 111 microversion: 2.1 time: 0.034733 Jun 20 14:53:23.471134 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 93/177] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:53:23 2022] DELETE /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:53:23.477067 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-60af61fb-e163-4076-9eb3-71cf039093a5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:23.477702 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-60af61fb-e163-4076-9eb3-71cf039093a5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] [instance: a4eeab20-5dea-4424-9945-640e8f24f6b0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:23.483941 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-60af61fb-e163-4076-9eb3-71cf039093a5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:23.484382 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-60af61fb-e163-4076-9eb3-71cf039093a5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:23.485208 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-60af61fb-e163-4076-9eb3-71cf039093a5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:23.485636 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-60af61fb-e163-4076-9eb3-71cf039093a5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:23.499194 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-60af61fb-e163-4076-9eb3-71cf039093a5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] HTTP exception thrown: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-60af61fb-e163-4076-9eb3-71cf039093a5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Request method failure captured: Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 HTTP/1.1 Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImj1_-0FTWTTgA196M9cho2a2oNkhrMn51-Yq0et8DPVd1fSTzDEgNAFqbSV3QO0LzJKvTjRpSq4Ndaih8U1WMtYV2saNtb4KsNacGdC0d51t_JjDY8wf26hQjJzoo_-vjlHBsyKbATnPKgnMSGhxcDndMIp0saPeMccJxARenRCoc Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: 361bd83b835c4ec3b01a1173b2d9cb1d Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-DeleteServersTestJSON-791467553 Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:53:23.500725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:53:23.502063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_361bd83b835c4ec3b01a1173b2d9cb1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/361bd83b835c4ec3b01a1173b2d9cb1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/361bd83b835c4ec3b01a1173b2d9cb1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/361bd83b835c4ec3b01a1173b2d9cb1d"}]}] Jun 20 14:53:23.502063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-DeleteServersTestJSON-791467553 Jun 20 14:53:23.502063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: 361bd83b835c4ec3b01a1173b2d9cb1d Jun 20 14:53:23.502063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-DeleteServersTestJSON-791467553 Jun 20 14:53:23.502063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-DeleteServersTestJSON-791467553-project Jun 20 14:53:23.502063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:53:23.502063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:53:23.502063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 75ebe0d05a1c4b66aa3b3abebd0ce026 Jun 20 14:53:23.502063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-DeleteServersTestJSON-791467553-project Jun 20 14:53:23.502063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:53:23.502063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:23.502063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': 'a4eeab20-5dea-4424-9945-640e8f24f6b0'} Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:53:23.502826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. Jun 20 14:53:23.504060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:53:23.505227 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-60af61fb-e163-4076-9eb3-71cf039093a5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] Returning 404 to user: Instance a4eeab20-5dea-4424-9945-640e8f24f6b0 could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:53:23.505227 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-60af61fb-e163-4076-9eb3-71cf039093a5 tempest-DeleteServersTestJSON-791467553 tempest-DeleteServersTestJSON-791467553-project] 10.222.0.23 "GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0" status: 404 len: 111 microversion: 2.1 time: 0.029359 Jun 20 14:53:23.505227 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 85/178] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:23 2022] GET /compute/v2.1/servers/a4eeab20-5dea-4424-9945-640e8f24f6b0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 14:53:24.250812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ec67a4fc-d1fe-4d1b-beb6-6f344b207eac tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:24.251537 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ec67a4fc-d1fe-4d1b-beb6-6f344b207eac tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:24.262138 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ec67a4fc-d1fe-4d1b-beb6-6f344b207eac tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:24.262606 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ec67a4fc-d1fe-4d1b-beb6-6f344b207eac tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:24.264910 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ec67a4fc-d1fe-4d1b-beb6-6f344b207eac tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:24.265362 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ec67a4fc-d1fe-4d1b-beb6-6f344b207eac tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:24.312572 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0ae8efe1-4954-45ce-b153-25a700486820 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:24.313698 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-0ae8efe1-4954-45ce-b153-25a700486820 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:24.322768 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0ae8efe1-4954-45ce-b153-25a700486820 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:24.323550 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0ae8efe1-4954-45ce-b153-25a700486820 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:24.325251 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0ae8efe1-4954-45ce-b153-25a700486820 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:24.326032 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0ae8efe1-4954-45ce-b153-25a700486820 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:24.491817 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0ae8efe1-4954-45ce-b153-25a700486820 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:24.509962 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0ae8efe1-4954-45ce-b153-25a700486820 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1497 microversion: 2.1 time: 0.202344 Jun 20 14:53:24.510591 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 86/179] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:24 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:24.559531 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ec67a4fc-d1fe-4d1b-beb6-6f344b207eac tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:24.563075 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=100 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:24.577520 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ec67a4fc-d1fe-4d1b-beb6-6f344b207eac tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.330898 Jun 20 14:53:24.578164 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 94/180] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:24 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:25.104682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-4ec7e5ae-1bd0-4cdd-850f-f8acf03ce64a tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:25.105556 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-4ec7e5ae-1bd0-4cdd-850f-f8acf03ce64a tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:25.111897 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4ec7e5ae-1bd0-4cdd-850f-f8acf03ce64a tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:25.112335 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4ec7e5ae-1bd0-4cdd-850f-f8acf03ce64a tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:25.113955 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4ec7e5ae-1bd0-4cdd-850f-f8acf03ce64a tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:25.114533 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4ec7e5ae-1bd0-4cdd-850f-f8acf03ce64a tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:25.168580 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-4ec7e5ae-1bd0-4cdd-850f-f8acf03ce64a tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 14:53:25.186866 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:25.315082 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-4ec7e5ae-1bd0-4cdd-850f-f8acf03ce64a tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "DELETE /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 204 len: 0 microversion: 2.1 time: 0.214014 Jun 20 14:53:25.317414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 87/181] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:53:25 2022] DELETE /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:53:25.332185 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7334d948-1f89-4ab4-a6a7-e8b9b3c9c02b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:25.334576 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7334d948-1f89-4ab4-a6a7-e8b9b3c9c02b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:25.345515 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7334d948-1f89-4ab4-a6a7-e8b9b3c9c02b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:25.346905 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7334d948-1f89-4ab4-a6a7-e8b9b3c9c02b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:25.349063 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7334d948-1f89-4ab4-a6a7-e8b9b3c9c02b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:25.349770 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7334d948-1f89-4ab4-a6a7-e8b9b3c9c02b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:25.598168 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ab8b709d-3a92-4163-acad-65df66deeb84 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:25.599371 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ab8b709d-3a92-4163-acad-65df66deeb84 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:25.611366 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7334d948-1f89-4ab4-a6a7-e8b9b3c9c02b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:25.612344 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ab8b709d-3a92-4163-acad-65df66deeb84 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:25.613348 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ab8b709d-3a92-4163-acad-65df66deeb84 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:25.614712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ab8b709d-3a92-4163-acad-65df66deeb84 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:25.615426 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ab8b709d-3a92-4163-acad-65df66deeb84 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:25.619576 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7334d948-1f89-4ab4-a6a7-e8b9b3c9c02b tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1503 microversion: 2.1 time: 0.297376 Jun 20 14:53:25.624823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 95/182] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:25 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1503 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:26.027405 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ab8b709d-3a92-4163-acad-65df66deeb84 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:26.038793 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ab8b709d-3a92-4163-acad-65df66deeb84 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.447363 Jun 20 14:53:26.045018 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 88/183] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:25 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:26.642785 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-4f299d5e-7dd7-4b80-8134-2f18e0074196 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:26.643912 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-4f299d5e-7dd7-4b80-8134-2f18e0074196 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:26.657435 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4f299d5e-7dd7-4b80-8134-2f18e0074196 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:26.657582 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4f299d5e-7dd7-4b80-8134-2f18e0074196 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:26.658486 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4f299d5e-7dd7-4b80-8134-2f18e0074196 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:26.658914 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4f299d5e-7dd7-4b80-8134-2f18e0074196 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:26.995556 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-4f299d5e-7dd7-4b80-8134-2f18e0074196 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:27.003047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-4f299d5e-7dd7-4b80-8134-2f18e0074196 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1503 microversion: 2.1 time: 0.365065 Jun 20 14:53:27.016259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 96/184] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:26 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1503 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:27.056852 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f4dd200b-6591-4da7-808b-fcd4a9ca8ed3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:27.057462 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f4dd200b-6591-4da7-808b-fcd4a9ca8ed3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:27.076448 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f4dd200b-6591-4da7-808b-fcd4a9ca8ed3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:27.077225 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f4dd200b-6591-4da7-808b-fcd4a9ca8ed3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:27.078077 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f4dd200b-6591-4da7-808b-fcd4a9ca8ed3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:27.078514 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f4dd200b-6591-4da7-808b-fcd4a9ca8ed3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:27.412898 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f4dd200b-6591-4da7-808b-fcd4a9ca8ed3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:27.424620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f4dd200b-6591-4da7-808b-fcd4a9ca8ed3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.372676 Jun 20 14:53:27.429515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 89/185] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:27 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:28.028300 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-030ec740-73f8-4ac1-841f-71231bcc65be tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:28.029833 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-030ec740-73f8-4ac1-841f-71231bcc65be tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:28.042055 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-030ec740-73f8-4ac1-841f-71231bcc65be tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:28.042671 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-030ec740-73f8-4ac1-841f-71231bcc65be tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:28.043589 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-030ec740-73f8-4ac1-841f-71231bcc65be tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:28.044409 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-030ec740-73f8-4ac1-841f-71231bcc65be tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:28.411887 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-030ec740-73f8-4ac1-841f-71231bcc65be tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:28.421420 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-030ec740-73f8-4ac1-841f-71231bcc65be tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1503 microversion: 2.1 time: 0.403990 Jun 20 14:53:28.423619 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 97/186] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:28 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1503 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:28.447416 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0f086857-beb0-4299-8c1c-e0417f32012a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:28.448027 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-0f086857-beb0-4299-8c1c-e0417f32012a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:28.468438 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0f086857-beb0-4299-8c1c-e0417f32012a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:28.468920 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0f086857-beb0-4299-8c1c-e0417f32012a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:28.469704 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0f086857-beb0-4299-8c1c-e0417f32012a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:28.470137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0f086857-beb0-4299-8c1c-e0417f32012a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:28.561178 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-2666849d-5ad5-4a69-b2a8-a3596342c35a req-591b706c-97dc-4f44-bc68-64e0b018aa26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407a64e8-ef64-49c1-9942-c1a455e8fef5", "name": "network-vif-deleted", "tag": "8d85ac9c-976c-4ea9-976b-b8bd72d48a2f"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:53:28.572250 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-2666849d-5ad5-4a69-b2a8-a3596342c35a req-591b706c-97dc-4f44-bc68-64e0b018aa26 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:28.572966 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-2666849d-5ad5-4a69-b2a8-a3596342c35a req-591b706c-97dc-4f44-bc68-64e0b018aa26 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:28.592283 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-2666849d-5ad5-4a69-b2a8-a3596342c35a req-591b706c-97dc-4f44-bc68-64e0b018aa26 service nova] Creating event network-vif-deleted:8d85ac9c-976c-4ea9-976b-b8bd72d48a2f for instance 407a64e8-ef64-49c1-9942-c1a455e8fef5 on hv-cinder-83697 Jun 20 14:53:28.599277 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-2666849d-5ad5-4a69-b2a8-a3596342c35a req-591b706c-97dc-4f44-bc68-64e0b018aa26 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042713 Jun 20 14:53:28.601845 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 98/187] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:53:29.056119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0f086857-beb0-4299-8c1c-e0417f32012a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:29.070452 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0f086857-beb0-4299-8c1c-e0417f32012a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.627848 Jun 20 14:53:29.071858 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 90/188] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:28 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:29.439969 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-84d8ca61-4709-47f3-9ae6-2c9cf7354b4d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:29.440865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-84d8ca61-4709-47f3-9ae6-2c9cf7354b4d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:29.449328 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-84d8ca61-4709-47f3-9ae6-2c9cf7354b4d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:29.449784 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-84d8ca61-4709-47f3-9ae6-2c9cf7354b4d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:29.450584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-84d8ca61-4709-47f3-9ae6-2c9cf7354b4d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:29.451011 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-84d8ca61-4709-47f3-9ae6-2c9cf7354b4d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:29.522990 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-84d8ca61-4709-47f3-9ae6-2c9cf7354b4d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:29.531432 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-84d8ca61-4709-47f3-9ae6-2c9cf7354b4d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1299 microversion: 2.1 time: 0.095718 Jun 20 14:53:29.532017 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 99/189] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:29 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:30.089260 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-9ca60fac-9821-4a81-9bf1-95b911a203e5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:30.090349 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-9ca60fac-9821-4a81-9bf1-95b911a203e5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:30.104382 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9ca60fac-9821-4a81-9bf1-95b911a203e5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:30.104939 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9ca60fac-9821-4a81-9bf1-95b911a203e5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:30.105607 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9ca60fac-9821-4a81-9bf1-95b911a203e5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:30.106701 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9ca60fac-9821-4a81-9bf1-95b911a203e5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:30.330504 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-9ca60fac-9821-4a81-9bf1-95b911a203e5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:30.344063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-9ca60fac-9821-4a81-9bf1-95b911a203e5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.259572 Jun 20 14:53:30.344685 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 91/190] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:30 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:53:30.553974 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-efa893c9-d3c7-414a-b324-df3b57eb304d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:30.555799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-efa893c9-d3c7-414a-b324-df3b57eb304d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:30.577742 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efa893c9-d3c7-414a-b324-df3b57eb304d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:30.581027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efa893c9-d3c7-414a-b324-df3b57eb304d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:30.581963 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efa893c9-d3c7-414a-b324-df3b57eb304d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:30.583091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efa893c9-d3c7-414a-b324-df3b57eb304d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:30.654351 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efa893c9-d3c7-414a-b324-df3b57eb304d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:30.656585 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efa893c9-d3c7-414a-b324-df3b57eb304d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:30.658911 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.objects.instance [None req-efa893c9-d3c7-414a-b324-df3b57eb304d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lazy-loading 'fault' on Instance uuid 407a64e8-ef64-49c1-9942-c1a455e8fef5 {{(pid=123979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:53:30.733790 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-efa893c9-d3c7-414a-b324-df3b57eb304d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:30.747132 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-efa893c9-d3c7-414a-b324-df3b57eb304d tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 200 len: 1304 microversion: 2.1 time: 0.200109 Jun 20 14:53:30.748073 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 100/191] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:30 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 1304 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:31.362485 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-396fe907-abb8-4b62-a536-e107ae84a653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:31.363474 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-396fe907-abb8-4b62-a536-e107ae84a653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:31.377553 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-396fe907-abb8-4b62-a536-e107ae84a653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:31.379085 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-396fe907-abb8-4b62-a536-e107ae84a653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:31.380707 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-396fe907-abb8-4b62-a536-e107ae84a653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:31.382474 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-396fe907-abb8-4b62-a536-e107ae84a653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:31.700385 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-396fe907-abb8-4b62-a536-e107ae84a653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:31.711004 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-396fe907-abb8-4b62-a536-e107ae84a653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.352715 Jun 20 14:53:31.723614 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 92/192] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:31 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:53:31.765269 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-30a367e2-6c8b-4d5a-9c25-883b6e2f11b4 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:31.766484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-30a367e2-6c8b-4d5a-9c25-883b6e2f11b4 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 407a64e8-ef64-49c1-9942-c1a455e8fef5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:31.773872 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-30a367e2-6c8b-4d5a-9c25-883b6e2f11b4 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:31.774537 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-30a367e2-6c8b-4d5a-9c25-883b6e2f11b4 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:31.775635 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-30a367e2-6c8b-4d5a-9c25-883b6e2f11b4 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:31.776553 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-30a367e2-6c8b-4d5a-9c25-883b6e2f11b4 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:31.796334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-30a367e2-6c8b-4d5a-9c25-883b6e2f11b4 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] HTTP exception thrown: Instance 407a64e8-ef64-49c1-9942-c1a455e8fef5 could not be found. Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-30a367e2-6c8b-4d5a-9c25-883b6e2f11b4 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Request method failure captured: Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 HTTP/1.1 Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisInKVe9mekttSINE3KqEBHoKS1CculmJRr2j04GKdBY7274Ny8_yS3TYfa9wALfDA6tcFIlTQAbU-ld3bwze_N7LVX_q7SUmr6crYtVzMel-zb5IVKSr4OqVzAk23nVqX-PvmnL7bK5990IWRB8YRDX31hTr7JCENIicy3ZuuZXFOFI Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: c461f88b7a00462c99532ec1262cb23c Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-VolumesActionsTest-834626655 Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:53:31.799023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:53:31.800599 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c461f88b7a00462c99532ec1262cb23c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c461f88b7a00462c99532ec1262cb23c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c461f88b7a00462c99532ec1262cb23c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c461f88b7a00462c99532ec1262cb23c"}]}] Jun 20 14:53:31.800599 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-VolumesActionsTest-834626655 Jun 20 14:53:31.800599 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: c461f88b7a00462c99532ec1262cb23c Jun 20 14:53:31.800599 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-VolumesActionsTest-834626655 Jun 20 14:53:31.800599 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-VolumesActionsTest-834626655-project Jun 20 14:53:31.800599 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:53:31.800599 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:53:31.800599 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: a4a159cc0128485482851c885de78e5d Jun 20 14:53:31.800599 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-VolumesActionsTest-834626655-project Jun 20 14:53:31.800599 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:53:31.800599 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance 407a64e8-ef64-49c1-9942-c1a455e8fef5 could not be found. Jun 20 14:53:31.800599 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '407a64e8-ef64-49c1-9942-c1a455e8fef5'} Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407a64e8-ef64-49c1-9942-c1a455e8fef5 could not be found. Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:53:31.801484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407a64e8-ef64-49c1-9942-c1a455e8fef5 could not be found. Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407a64e8-ef64-49c1-9942-c1a455e8fef5 could not be found. Jun 20 14:53:31.802964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:53:31.805437 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-30a367e2-6c8b-4d5a-9c25-883b6e2f11b4 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Returning 404 to user: Instance 407a64e8-ef64-49c1-9942-c1a455e8fef5 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:53:31.806451 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-30a367e2-6c8b-4d5a-9c25-883b6e2f11b4 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5" status: 404 len: 111 microversion: 2.1 time: 0.045381 Jun 20 14:53:31.807548 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 101/193] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:31 2022] GET /compute/v2.1/servers/407a64e8-ef64-49c1-9942-c1a455e8fef5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:53:32.052370 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-539442066", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "networks": [{"uuid": "156bc734-fceb-4cfe-9464-367866d760d0"}]}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:53:32.151981 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.network.neutron [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] validate_networks() for [('156bc734-fceb-4cfe-9464-367866d760d0', None, None, None, None, None)] {{(pid=123978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:53:32.729454 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-03cbbaab-bdd4-4a43-93e7-cd5941025653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:32.730317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-03cbbaab-bdd4-4a43-93e7-cd5941025653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:32.744775 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-03cbbaab-bdd4-4a43-93e7-cd5941025653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:32.745614 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-03cbbaab-bdd4-4a43-93e7-cd5941025653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:32.746606 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-03cbbaab-bdd4-4a43-93e7-cd5941025653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:32.747220 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-03cbbaab-bdd4-4a43-93e7-cd5941025653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:33.213099 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Flavor limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:53:33.213099 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Image limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:53:33.213099 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Flavor pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:53:33.215487 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Image pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:53:33.215938 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:53:33.254528 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:33.254528 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:33.254681 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:33.255089 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:33.321641 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-03cbbaab-bdd4-4a43-93e7-cd5941025653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:33.325654 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Getting quotas for project c461f88b7a00462c99532ec1262cb23c. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:53:33.331425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-03cbbaab-bdd4-4a43-93e7-cd5941025653 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.606147 Jun 20 14:53:33.333840 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Getting quotas for user a4a159cc0128485482851c885de78e5d and project c461f88b7a00462c99532ec1262cb23c. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:53:33.337904 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 102/194] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:32 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:33.390055 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Going to run 1 instances... {{(pid=123978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:53:33.392383 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:53:33.504851 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2ba8304f-5b7d-42ef-9d19-ebb55b8c4d53 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.456291 Jun 20 14:53:33.505542 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 93/195] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 14:53:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 14:53:33.516510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-5de77492-90d7-42ed-af71-0cd14b9113d1 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:33.517370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-5de77492-90d7-42ed-af71-0cd14b9113d1 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:33.665518 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-5de77492-90d7-42ed-af71-0cd14b9113d1 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:33.674749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-5de77492-90d7-42ed-af71-0cd14b9113d1 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1213 microversion: 2.1 time: 0.162424 Jun 20 14:53:33.692919 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 103/196] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:33 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:34.354612 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-13a26027-dc5c-4360-9030-2bc5c7c73469 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:34.355442 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-13a26027-dc5c-4360-9030-2bc5c7c73469 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:34.366707 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-13a26027-dc5c-4360-9030-2bc5c7c73469 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:34.367157 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-13a26027-dc5c-4360-9030-2bc5c7c73469 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:34.367948 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-13a26027-dc5c-4360-9030-2bc5c7c73469 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:34.368379 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-13a26027-dc5c-4360-9030-2bc5c7c73469 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:34.701973 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1cb5b255-0bce-4e04-a91f-7b4ecf8cc0aa tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:34.703564 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-1cb5b255-0bce-4e04-a91f-7b4ecf8cc0aa tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:34.713796 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1cb5b255-0bce-4e04-a91f-7b4ecf8cc0aa tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:34.714811 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1cb5b255-0bce-4e04-a91f-7b4ecf8cc0aa tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:34.715913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1cb5b255-0bce-4e04-a91f-7b4ecf8cc0aa tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:34.716513 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1cb5b255-0bce-4e04-a91f-7b4ecf8cc0aa tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:34.814960 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-13a26027-dc5c-4360-9030-2bc5c7c73469 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:34.829295 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-13a26027-dc5c-4360-9030-2bc5c7c73469 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1523 microversion: 2.1 time: 0.478640 Jun 20 14:53:34.842395 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 94/197] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:34 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1523 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:34.850267 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-1cb5b255-0bce-4e04-a91f-7b4ecf8cc0aa tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:34.861551 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1cb5b255-0bce-4e04-a91f-7b4ecf8cc0aa tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1217 microversion: 2.1 time: 0.166391 Jun 20 14:53:34.862666 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 104/198] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:34 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:35.856102 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d916cc99-34ee-4476-bd77-54ad827c52a0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:35.858185 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-d916cc99-34ee-4476-bd77-54ad827c52a0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:35.877898 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d95c95fe-4088-4d88-933b-831bb2228f0e tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:35.878573 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d95c95fe-4088-4d88-933b-831bb2228f0e tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:35.899239 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d916cc99-34ee-4476-bd77-54ad827c52a0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:35.901826 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d95c95fe-4088-4d88-933b-831bb2228f0e tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:35.902269 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d916cc99-34ee-4476-bd77-54ad827c52a0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:35.902903 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d95c95fe-4088-4d88-933b-831bb2228f0e tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:35.903967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d916cc99-34ee-4476-bd77-54ad827c52a0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:35.905278 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d916cc99-34ee-4476-bd77-54ad827c52a0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:35.906234 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d95c95fe-4088-4d88-933b-831bb2228f0e tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:35.906879 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d95c95fe-4088-4d88-933b-831bb2228f0e tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:36.066332 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d95c95fe-4088-4d88-933b-831bb2228f0e tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:36.086522 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d95c95fe-4088-4d88-933b-831bb2228f0e tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1265 microversion: 2.1 time: 0.209555 Jun 20 14:53:36.088877 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 105/199] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:35 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:36.321140 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d916cc99-34ee-4476-bd77-54ad827c52a0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:36.333847 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d916cc99-34ee-4476-bd77-54ad827c52a0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1503 microversion: 2.1 time: 0.485793 Jun 20 14:53:36.340923 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 95/200] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:35 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1503 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:36.351397 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e785dd57-a004-477a-aedc-bff3941fd3ab tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:36.352398 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e785dd57-a004-477a-aedc-bff3941fd3ab tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:36.368016 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e785dd57-a004-477a-aedc-bff3941fd3ab tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:36.369000 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e785dd57-a004-477a-aedc-bff3941fd3ab tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:36.371788 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e785dd57-a004-477a-aedc-bff3941fd3ab tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:36.373822 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e785dd57-a004-477a-aedc-bff3941fd3ab tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:36.961086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e785dd57-a004-477a-aedc-bff3941fd3ab tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:36.970876 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e785dd57-a004-477a-aedc-bff3941fd3ab tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1516 microversion: 2.1 time: 0.624318 Jun 20 14:53:36.979859 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 106/201] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:36 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1516 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:37.104635 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-da2c8704-6278-452e-b13f-4d31d9791aef tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:37.105394 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-da2c8704-6278-452e-b13f-4d31d9791aef tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:37.116310 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-da2c8704-6278-452e-b13f-4d31d9791aef tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:37.126440 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-da2c8704-6278-452e-b13f-4d31d9791aef tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:37.128250 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-da2c8704-6278-452e-b13f-4d31d9791aef tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:37.130111 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-da2c8704-6278-452e-b13f-4d31d9791aef tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:37.401784 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-da2c8704-6278-452e-b13f-4d31d9791aef tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:37.413183 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-da2c8704-6278-452e-b13f-4d31d9791aef tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1271 microversion: 2.1 time: 0.312765 Jun 20 14:53:37.414802 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 96/202] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:37 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1271 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:38.430273 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-88675ccc-053b-44fb-ae9d-9620d800c108 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:38.430876 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-88675ccc-053b-44fb-ae9d-9620d800c108 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:38.440778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-88675ccc-053b-44fb-ae9d-9620d800c108 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:38.444687 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-88675ccc-053b-44fb-ae9d-9620d800c108 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:38.445850 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-88675ccc-053b-44fb-ae9d-9620d800c108 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:38.446461 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-88675ccc-053b-44fb-ae9d-9620d800c108 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:38.712241 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-88675ccc-053b-44fb-ae9d-9620d800c108 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:38.729076 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-88675ccc-053b-44fb-ae9d-9620d800c108 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1271 microversion: 2.1 time: 0.303208 Jun 20 14:53:38.730324 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 107/203] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:38 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1271 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:39.752287 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-396421d5-246a-43db-8061-67d8d26da862 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:39.755357 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-396421d5-246a-43db-8061-67d8d26da862 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:39.790454 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-396421d5-246a-43db-8061-67d8d26da862 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:39.804198 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-396421d5-246a-43db-8061-67d8d26da862 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:39.805259 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-396421d5-246a-43db-8061-67d8d26da862 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:39.805751 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-396421d5-246a-43db-8061-67d8d26da862 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:39.939421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e8f9a541-4c13-4a0c-89c5-5155f2397c43 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:53:39.941095 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e8f9a541-4c13-4a0c-89c5-5155f2397c43 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:39.954854 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e8f9a541-4c13-4a0c-89c5-5155f2397c43 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:39.955289 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e8f9a541-4c13-4a0c-89c5-5155f2397c43 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:39.956305 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e8f9a541-4c13-4a0c-89c5-5155f2397c43 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:39.957017 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e8f9a541-4c13-4a0c-89c5-5155f2397c43 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:40.015431 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-396421d5-246a-43db-8061-67d8d26da862 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:40.028105 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-396421d5-246a-43db-8061-67d8d26da862 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1271 microversion: 2.1 time: 0.282983 Jun 20 14:53:40.031192 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 97/204] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:39 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1271 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:40.082424 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.objects.instance [None req-e8f9a541-4c13-4a0c-89c5-5155f2397c43 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lazy-loading 'flavor' on Instance uuid 80267d79-170a-4c4e-b7fe-dfff49c7f195 {{(pid=123979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:53:40.292161 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e8f9a541-4c13-4a0c-89c5-5155f2397c43 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "POST /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195/action" status: 200 len: 32 microversion: 2.1 time: 0.359476 Jun 20 14:53:40.294220 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 108/205] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 14:53:39 2022] POST /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195/action => generated 32 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 14:53:40.307314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-4b6d4f3e-945a-4da2-82e6-ea92c7735a46 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:40.308366 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-4b6d4f3e-945a-4da2-82e6-ea92c7735a46 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:40.331877 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4b6d4f3e-945a-4da2-82e6-ea92c7735a46 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:40.332752 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4b6d4f3e-945a-4da2-82e6-ea92c7735a46 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:40.335091 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4b6d4f3e-945a-4da2-82e6-ea92c7735a46 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:40.340167 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4b6d4f3e-945a-4da2-82e6-ea92c7735a46 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:41.047944 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-838999d0-b6db-4d41-a91d-5ce6a6d8d1af tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:41.048412 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-838999d0-b6db-4d41-a91d-5ce6a6d8d1af tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:41.057765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-838999d0-b6db-4d41-a91d-5ce6a6d8d1af tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:41.058346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-838999d0-b6db-4d41-a91d-5ce6a6d8d1af tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:41.058983 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-838999d0-b6db-4d41-a91d-5ce6a6d8d1af tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:41.059412 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-838999d0-b6db-4d41-a91d-5ce6a6d8d1af tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:41.137658 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-4b6d4f3e-945a-4da2-82e6-ea92c7735a46 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:41.150637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-4b6d4f3e-945a-4da2-82e6-ea92c7735a46 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 0.851508 Jun 20 14:53:41.151237 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 98/206] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:40 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:41.483105 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-838999d0-b6db-4d41-a91d-5ce6a6d8d1af tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:41.498362 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-838999d0-b6db-4d41-a91d-5ce6a6d8d1af tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1313 microversion: 2.1 time: 0.454771 Jun 20 14:53:41.498949 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 109/207] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:41 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:41.596209 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-896033dc-2508-40aa-b9e3-4e06b0630a01 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Action: 'create', calling method: .version_select at 0x7fce51f2b8b0>, body: {"keypair": {"name": "tempest-keypair-1926544898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlIsM2/SSd/Mo6TSnarVOPhmRoCk6GxlWtQw1shpX3Z80f0+26FjwA8zZ9GgrSjT2hC8eTh/e9mXKe9SyFiVZ8u8m+X6TPZ1gMA9F4ghoY59EnMaVzusFXVbt5duezzsg=="}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:53:41.647145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-896033dc-2508-40aa-b9e3-4e06b0630a01 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Getting quotas for project a98f7478c9384ee298321a1506aa0bde. Resources: {'key_pairs'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:53:41.651531 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-896033dc-2508-40aa-b9e3-4e06b0630a01 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Getting quotas for user 69c4f81285904da78e96a4a515ec2cb2 and project a98f7478c9384ee298321a1506aa0bde. Resources: {'key_pairs'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:53:41.663675 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:41.711044 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-896033dc-2508-40aa-b9e3-4e06b0630a01 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.432395 Jun 20 14:53:41.711978 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 99/208] 10.222.0.23 () {62 vars in 1199 bytes} [Mon Jun 20 14:53:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 434 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 20 14:53:42.168311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7b4fc6f5-7aaf-4596-9a7b-7bac19529d19 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:42.168906 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7b4fc6f5-7aaf-4596-9a7b-7bac19529d19 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:42.172094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=70 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:42.183102 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7b4fc6f5-7aaf-4596-9a7b-7bac19529d19 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:42.187237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7b4fc6f5-7aaf-4596-9a7b-7bac19529d19 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:42.188828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7b4fc6f5-7aaf-4596-9a7b-7bac19529d19 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:42.194294 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7b4fc6f5-7aaf-4596-9a7b-7bac19529d19 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:42.516040 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-45645908-054d-446a-bb2a-f63465d62866 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:42.517330 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-45645908-054d-446a-bb2a-f63465d62866 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:42.530552 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-45645908-054d-446a-bb2a-f63465d62866 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:42.531395 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-45645908-054d-446a-bb2a-f63465d62866 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:42.532410 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-45645908-054d-446a-bb2a-f63465d62866 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:42.533639 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-45645908-054d-446a-bb2a-f63465d62866 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:42.682028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7b4fc6f5-7aaf-4596-9a7b-7bac19529d19 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:42.700918 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7b4fc6f5-7aaf-4596-9a7b-7bac19529d19 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 0.536020 Jun 20 14:53:42.704568 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 110/209] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:42 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:42.876575 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-45645908-054d-446a-bb2a-f63465d62866 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:42.884556 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-45645908-054d-446a-bb2a-f63465d62866 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1313 microversion: 2.1 time: 0.373076 Jun 20 14:53:42.897491 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 100/210] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:42 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:53:43.559482 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-eeaa2ee7-eccd-4c01-9461-5170a89b4705 req-41081ffc-6f8b-4d10-b028-0104f54d0d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f72986c-e4c6-440b-97f9-4b5e7444f448", "tag": "58d38709-d644-420a-adf0-6acafb161ee3"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:53:43.593132 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-eeaa2ee7-eccd-4c01-9461-5170a89b4705 req-41081ffc-6f8b-4d10-b028-0104f54d0d32 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:43.595185 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-eeaa2ee7-eccd-4c01-9461-5170a89b4705 req-41081ffc-6f8b-4d10-b028-0104f54d0d32 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:43.625008 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-eeaa2ee7-eccd-4c01-9461-5170a89b4705 req-41081ffc-6f8b-4d10-b028-0104f54d0d32 service nova] Creating event network-changed:58d38709-d644-420a-adf0-6acafb161ee3 for instance 9f72986c-e4c6-440b-97f9-4b5e7444f448 on hv-cinder-83697 Jun 20 14:53:43.632544 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-eeaa2ee7-eccd-4c01-9461-5170a89b4705 req-41081ffc-6f8b-4d10-b028-0104f54d0d32 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078316 Jun 20 14:53:43.633694 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 111/211] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:53:43.721681 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0a52ff98-5d7a-4e3c-9867-db035202f273 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:43.722842 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-0a52ff98-5d7a-4e3c-9867-db035202f273 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:43.739683 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:43.793222 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0a52ff98-5d7a-4e3c-9867-db035202f273 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:43.797474 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0a52ff98-5d7a-4e3c-9867-db035202f273 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:43.804701 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0a52ff98-5d7a-4e3c-9867-db035202f273 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:43.805995 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0a52ff98-5d7a-4e3c-9867-db035202f273 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:43.909457 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-789afa7f-9c1e-4020-8762-b276e0774307 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:43.910239 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-789afa7f-9c1e-4020-8762-b276e0774307 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:43.917669 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:43.919822 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-789afa7f-9c1e-4020-8762-b276e0774307 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:43.921817 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-789afa7f-9c1e-4020-8762-b276e0774307 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:43.922881 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-789afa7f-9c1e-4020-8762-b276e0774307 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:43.923528 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-789afa7f-9c1e-4020-8762-b276e0774307 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:43.928819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:44.444659 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-789afa7f-9c1e-4020-8762-b276e0774307 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:44.453884 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-789afa7f-9c1e-4020-8762-b276e0774307 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1313 microversion: 2.1 time: 0.549050 Jun 20 14:53:44.454472 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 112/212] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:43 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1313 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:53:44.828424 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0a52ff98-5d7a-4e3c-9867-db035202f273 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:44.843427 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0a52ff98-5d7a-4e3c-9867-db035202f273 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 1.126369 Jun 20 14:53:44.844189 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 101/213] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:43 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:45.473691 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8c96f699-98af-4c27-964a-55d0fbed7606 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:45.475030 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-8c96f699-98af-4c27-964a-55d0fbed7606 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:45.485968 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8c96f699-98af-4c27-964a-55d0fbed7606 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:45.491249 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8c96f699-98af-4c27-964a-55d0fbed7606 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:45.492623 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8c96f699-98af-4c27-964a-55d0fbed7606 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:45.493170 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8c96f699-98af-4c27-964a-55d0fbed7606 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:45.870377 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e0ee90ee-932d-4eda-9987-87562b0ba0be tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:45.871410 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e0ee90ee-932d-4eda-9987-87562b0ba0be tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:45.923075 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e0ee90ee-932d-4eda-9987-87562b0ba0be tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:45.923843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e0ee90ee-932d-4eda-9987-87562b0ba0be tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:45.925151 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e0ee90ee-932d-4eda-9987-87562b0ba0be tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:45.939112 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e0ee90ee-932d-4eda-9987-87562b0ba0be tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:46.090172 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8c96f699-98af-4c27-964a-55d0fbed7606 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:46.127701 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-8c96f699-98af-4c27-964a-55d0fbed7606 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1313 microversion: 2.1 time: 0.640730 Jun 20 14:53:46.132096 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 113/214] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:45 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1313 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:46.176353 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2082735763", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65993a3b-f9af-4743-b7d5-a4affcfed083"}], "security_groups": [{"name": "tempest-securitygroup--1187725134"}], "key_name": "tempest-keypair-1926544898", "user_data": "}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:53:46.649855 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.network.neutron [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] validate_networks() for [('65993a3b-f9af-4743-b7d5-a4affcfed083', None, None, None, None, None)] {{(pid=123979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:53:46.809135 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-e0ee90ee-932d-4eda-9987-87562b0ba0be tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:46.830828 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e0ee90ee-932d-4eda-9987-87562b0ba0be tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 0.967083 Jun 20 14:53:46.833867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 102/215] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:45 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:47.149598 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d4ec6157-779d-46bd-81c6-7788dd327080 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:47.150435 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-d4ec6157-779d-46bd-81c6-7788dd327080 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:47.164210 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d4ec6157-779d-46bd-81c6-7788dd327080 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:47.165102 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d4ec6157-779d-46bd-81c6-7788dd327080 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:47.167262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d4ec6157-779d-46bd-81c6-7788dd327080 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:47.169612 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d4ec6157-779d-46bd-81c6-7788dd327080 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:47.472599 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d4ec6157-779d-46bd-81c6-7788dd327080 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:47.484833 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d4ec6157-779d-46bd-81c6-7788dd327080 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1313 microversion: 2.1 time: 0.338563 Jun 20 14:53:47.485475 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 103/216] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:47 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:47.852761 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-621c89cb-c9f5-44e0-aaff-37110590146c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:47.853378 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-621c89cb-c9f5-44e0-aaff-37110590146c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:47.878847 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-621c89cb-c9f5-44e0-aaff-37110590146c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:47.879442 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-621c89cb-c9f5-44e0-aaff-37110590146c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:47.881464 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-621c89cb-c9f5-44e0-aaff-37110590146c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:47.884315 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-621c89cb-c9f5-44e0-aaff-37110590146c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:48.122145 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Flavor limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:53:48.122636 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Image limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:53:48.123017 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Flavor pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:53:48.123419 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Image pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:53:48.123827 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:53:48.148073 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:48.148523 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:48.149362 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:48.149791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:48.196992 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Getting quotas for project a98f7478c9384ee298321a1506aa0bde. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:53:48.201872 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Getting quotas for user 69c4f81285904da78e96a4a515ec2cb2 and project a98f7478c9384ee298321a1506aa0bde. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:53:48.224009 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Going to run 1 instances... {{(pid=123979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:53:48.242055 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:53:48.370507 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-621c89cb-c9f5-44e0-aaff-37110590146c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:48.377242 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:48.384436 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-621c89cb-c9f5-44e0-aaff-37110590146c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 0.536788 Jun 20 14:53:48.401107 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 104/217] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:47 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:53:48.427101 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-37ff79a5-6f68-4a93-881d-6e4d671e910e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.263472 Jun 20 14:53:48.441894 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 114/218] 10.222.0.23 () {62 vars in 1187 bytes} [Mon Jun 20 14:53:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 2279 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 14:53:48.453703 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ee9d96db-f04b-4b06-a463-0237b04842cc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:48.454689 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ee9d96db-f04b-4b06-a463-0237b04842cc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:48.519296 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-fef57ef1-733d-450b-adf8-4091c82b9842 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:48.522636 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-fef57ef1-733d-450b-adf8-4091c82b9842 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:48.543597 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fef57ef1-733d-450b-adf8-4091c82b9842 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:48.544304 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fef57ef1-733d-450b-adf8-4091c82b9842 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:48.545586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fef57ef1-733d-450b-adf8-4091c82b9842 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:48.548089 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fef57ef1-733d-450b-adf8-4091c82b9842 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:48.883412 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ee9d96db-f04b-4b06-a463-0237b04842cc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:48.908369 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ee9d96db-f04b-4b06-a463-0237b04842cc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:48.920403 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ee9d96db-f04b-4b06-a463-0237b04842cc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:48.921502 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-fef57ef1-733d-450b-adf8-4091c82b9842 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:48.923217 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ee9d96db-f04b-4b06-a463-0237b04842cc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1282 microversion: 2.20 time: 0.474900 Jun 20 14:53:48.925907 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 105/219] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:53:48 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1282 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:53:48.930939 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-fef57ef1-733d-450b-adf8-4091c82b9842 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1313 microversion: 2.1 time: 0.432076 Jun 20 14:53:48.931543 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 115/220] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:48 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:49.413966 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2c28fecb-4ee1-4373-8970-eea2d474ef16 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:49.414819 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2c28fecb-4ee1-4373-8970-eea2d474ef16 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:49.431840 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2c28fecb-4ee1-4373-8970-eea2d474ef16 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:49.436339 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2c28fecb-4ee1-4373-8970-eea2d474ef16 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:49.440579 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2c28fecb-4ee1-4373-8970-eea2d474ef16 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:49.441277 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2c28fecb-4ee1-4373-8970-eea2d474ef16 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:49.907553 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2c28fecb-4ee1-4373-8970-eea2d474ef16 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:49.918454 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2c28fecb-4ee1-4373-8970-eea2d474ef16 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 0.513412 Jun 20 14:53:49.920125 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 106/221] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:49 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:49.944081 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-15066b91-d461-4eb3-a0ae-787e43b7f76d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:49.944687 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-15066b91-d461-4eb3-a0ae-787e43b7f76d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:49.947825 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1813c28f-3908-44d2-9047-d54c98c9a827 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:49.948436 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1813c28f-3908-44d2-9047-d54c98c9a827 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:49.951923 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-15066b91-d461-4eb3-a0ae-787e43b7f76d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:49.952360 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-15066b91-d461-4eb3-a0ae-787e43b7f76d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:49.953202 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-15066b91-d461-4eb3-a0ae-787e43b7f76d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:49.957673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1813c28f-3908-44d2-9047-d54c98c9a827 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:49.958145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1813c28f-3908-44d2-9047-d54c98c9a827 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:49.958764 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-15066b91-d461-4eb3-a0ae-787e43b7f76d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:49.962188 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1813c28f-3908-44d2-9047-d54c98c9a827 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:49.963043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1813c28f-3908-44d2-9047-d54c98c9a827 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:50.082654 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-15066b91-d461-4eb3-a0ae-787e43b7f76d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:50.115368 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-15066b91-d461-4eb3-a0ae-787e43b7f76d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:50.120066 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-15066b91-d461-4eb3-a0ae-787e43b7f76d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:50.123515 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-15066b91-d461-4eb3-a0ae-787e43b7f76d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1334 microversion: 2.20 time: 0.183231 Jun 20 14:53:50.139529 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 116/222] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:53:49 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1334 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:53:50.397570 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1813c28f-3908-44d2-9047-d54c98c9a827 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:50.409087 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1813c28f-3908-44d2-9047-d54c98c9a827 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1313 microversion: 2.1 time: 0.465515 Jun 20 14:53:50.412525 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 107/223] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:49 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:50.935524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6ef78883-ed5a-4806-90bf-6e3e1adc3969 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:50.936128 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-6ef78883-ed5a-4806-90bf-6e3e1adc3969 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:50.949829 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6ef78883-ed5a-4806-90bf-6e3e1adc3969 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:50.950457 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6ef78883-ed5a-4806-90bf-6e3e1adc3969 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:50.951040 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6ef78883-ed5a-4806-90bf-6e3e1adc3969 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:50.951445 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6ef78883-ed5a-4806-90bf-6e3e1adc3969 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:51.144329 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-51e399cf-fe61-44d5-ad1a-820f28e49ef2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:51.144960 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-51e399cf-fe61-44d5-ad1a-820f28e49ef2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:51.158725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-51e399cf-fe61-44d5-ad1a-820f28e49ef2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:51.162957 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-51e399cf-fe61-44d5-ad1a-820f28e49ef2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:51.164004 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-51e399cf-fe61-44d5-ad1a-820f28e49ef2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:51.165863 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-51e399cf-fe61-44d5-ad1a-820f28e49ef2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:51.320031 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-51e399cf-fe61-44d5-ad1a-820f28e49ef2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:51.331924 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-51e399cf-fe61-44d5-ad1a-820f28e49ef2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:51.348415 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-51e399cf-fe61-44d5-ad1a-820f28e49ef2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:51.352025 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-51e399cf-fe61-44d5-ad1a-820f28e49ef2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1340 microversion: 2.20 time: 0.212413 Jun 20 14:53:51.352967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 108/224] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:53:51 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1340 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:53:51.368848 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6ef78883-ed5a-4806-90bf-6e3e1adc3969 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:51.387298 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6ef78883-ed5a-4806-90bf-6e3e1adc3969 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 0.452177 Jun 20 14:53:51.400457 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 117/225] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:50 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:51.428312 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1cf9762a-adda-4f94-a468-a19915fd20c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:51.429270 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1cf9762a-adda-4f94-a468-a19915fd20c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:51.436588 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1cf9762a-adda-4f94-a468-a19915fd20c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:51.437068 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1cf9762a-adda-4f94-a468-a19915fd20c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:51.437836 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1cf9762a-adda-4f94-a468-a19915fd20c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:51.438577 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1cf9762a-adda-4f94-a468-a19915fd20c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:51.745072 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1cf9762a-adda-4f94-a468-a19915fd20c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:51.772158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1cf9762a-adda-4f94-a468-a19915fd20c3 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1313 microversion: 2.1 time: 0.346230 Jun 20 14:53:51.774447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 109/226] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:51 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:51.798098 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-710d42d8-9eb3-40c9-8260-626d93d315b7 req-20c9a24e-0e28-4690-9b59-7cfac2ca0d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f72986c-e4c6-440b-97f9-4b5e7444f448", "name": "network-vif-plugged", "status": "completed", "tag": "58d38709-d644-420a-adf0-6acafb161ee3"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:53:51.823407 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-710d42d8-9eb3-40c9-8260-626d93d315b7 req-20c9a24e-0e28-4690-9b59-7cfac2ca0d28 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:51.824140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-710d42d8-9eb3-40c9-8260-626d93d315b7 req-20c9a24e-0e28-4690-9b59-7cfac2ca0d28 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:51.876418 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-710d42d8-9eb3-40c9-8260-626d93d315b7 req-20c9a24e-0e28-4690-9b59-7cfac2ca0d28 service nova] Creating event network-vif-plugged:58d38709-d644-420a-adf0-6acafb161ee3 for instance 9f72986c-e4c6-440b-97f9-4b5e7444f448 on hv-cinder-83697 Jun 20 14:53:51.903757 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-710d42d8-9eb3-40c9-8260-626d93d315b7 req-20c9a24e-0e28-4690-9b59-7cfac2ca0d28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109299 Jun 20 14:53:51.905486 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 118/227] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:53:52.370842 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3ebce1ce-2189-4121-b6b2-2594a8055058 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:52.371451 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-3ebce1ce-2189-4121-b6b2-2594a8055058 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:52.385711 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3ebce1ce-2189-4121-b6b2-2594a8055058 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:52.386094 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3ebce1ce-2189-4121-b6b2-2594a8055058 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:52.386892 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3ebce1ce-2189-4121-b6b2-2594a8055058 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:52.387323 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3ebce1ce-2189-4121-b6b2-2594a8055058 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:52.406249 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7781e1f8-b3d4-4534-a798-426c447e1a40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:52.406934 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7781e1f8-b3d4-4534-a798-426c447e1a40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:52.424960 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7781e1f8-b3d4-4534-a798-426c447e1a40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:52.425407 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7781e1f8-b3d4-4534-a798-426c447e1a40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:52.426182 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7781e1f8-b3d4-4534-a798-426c447e1a40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:52.426700 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7781e1f8-b3d4-4534-a798-426c447e1a40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:52.735682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7781e1f8-b3d4-4534-a798-426c447e1a40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:52.742272 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3ebce1ce-2189-4121-b6b2-2594a8055058 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:52.746559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7781e1f8-b3d4-4534-a798-426c447e1a40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 0.344374 Jun 20 14:53:52.754617 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 119/228] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:52 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:52.773314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3ebce1ce-2189-4121-b6b2-2594a8055058 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:52.779556 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3ebce1ce-2189-4121-b6b2-2594a8055058 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:52.783107 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-3ebce1ce-2189-4121-b6b2-2594a8055058 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1408 microversion: 2.20 time: 0.416330 Jun 20 14:53:52.789091 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 110/229] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:53:52 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1408 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:53:52.792764 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-15179386-f089-41b5-bc5d-d5e7b9441311 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:52.793914 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-15179386-f089-41b5-bc5d-d5e7b9441311 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:52.802299 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-15179386-f089-41b5-bc5d-d5e7b9441311 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:52.805801 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-15179386-f089-41b5-bc5d-d5e7b9441311 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:52.813830 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-15179386-f089-41b5-bc5d-d5e7b9441311 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:52.814884 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-15179386-f089-41b5-bc5d-d5e7b9441311 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:53.146456 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-15179386-f089-41b5-bc5d-d5e7b9441311 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:53.163393 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-15179386-f089-41b5-bc5d-d5e7b9441311 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1313 microversion: 2.1 time: 0.374996 Jun 20 14:53:53.165416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 120/230] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:52 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:53.517568 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-bfbca04f-fe1b-44ff-abbb-c010fa76cb3c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:53.518137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-bfbca04f-fe1b-44ff-abbb-c010fa76cb3c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:53.528355 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bfbca04f-fe1b-44ff-abbb-c010fa76cb3c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:53.528838 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bfbca04f-fe1b-44ff-abbb-c010fa76cb3c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:53.529619 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bfbca04f-fe1b-44ff-abbb-c010fa76cb3c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:53.530040 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bfbca04f-fe1b-44ff-abbb-c010fa76cb3c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:53.632834 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-bfbca04f-fe1b-44ff-abbb-c010fa76cb3c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e/ips" status: 200 len: 149 microversion: 2.1 time: 0.120009 Jun 20 14:53:53.649916 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 111/231] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 14:53:53 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e/ips => generated 149 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:53:53.763782 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-54153e9f-8854-4a0a-a844-bb4abc2c60d0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:53.770594 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-54153e9f-8854-4a0a-a844-bb4abc2c60d0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:53.774967 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-54153e9f-8854-4a0a-a844-bb4abc2c60d0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:53.775393 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-54153e9f-8854-4a0a-a844-bb4abc2c60d0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:53.776253 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-54153e9f-8854-4a0a-a844-bb4abc2c60d0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:53.776664 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-54153e9f-8854-4a0a-a844-bb4abc2c60d0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:53.811059 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b38dabab-1059-43a3-a378-513e1a9d368b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:53.811681 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-b38dabab-1059-43a3-a378-513e1a9d368b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:53.832336 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b38dabab-1059-43a3-a378-513e1a9d368b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:53.833029 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b38dabab-1059-43a3-a378-513e1a9d368b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:53.833907 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b38dabab-1059-43a3-a378-513e1a9d368b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:53.834338 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b38dabab-1059-43a3-a378-513e1a9d368b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:54.197855 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-b38dabab-1059-43a3-a378-513e1a9d368b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:54.217105 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-b38dabab-1059-43a3-a378-513e1a9d368b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:54.220697 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-b38dabab-1059-43a3-a378-513e1a9d368b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:54.227991 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b38dabab-1059-43a3-a378-513e1a9d368b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1408 microversion: 2.20 time: 0.420398 Jun 20 14:53:54.229089 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 112/232] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:53:53 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1408 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:53:54.238707 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d1e912de-30ad-4a50-98ee-490028eb7277 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:54.241052 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-d1e912de-30ad-4a50-98ee-490028eb7277 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:54.262360 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d1e912de-30ad-4a50-98ee-490028eb7277 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:54.262781 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d1e912de-30ad-4a50-98ee-490028eb7277 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:54.265478 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d1e912de-30ad-4a50-98ee-490028eb7277 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:54.265926 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d1e912de-30ad-4a50-98ee-490028eb7277 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:54.606954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d1e912de-30ad-4a50-98ee-490028eb7277 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:54.624179 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d1e912de-30ad-4a50-98ee-490028eb7277 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1496 microversion: 2.1 time: 0.392662 Jun 20 14:53:54.624803 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 113/233] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:54 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1496 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:54.631181 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-2b8c8123-20eb-4121-9c8c-394f390e40dc req-9138f5a7-16aa-4226-ad2b-cee0f8ad38bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "916159e1-4580-4bb4-a78f-857e9e15c61b", "tag": "4003555e-bf92-479e-b2dd-be6fe4500b56"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:53:54.645419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-2b8c8123-20eb-4121-9c8c-394f390e40dc req-9138f5a7-16aa-4226-ad2b-cee0f8ad38bd service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:54.646088 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-2b8c8123-20eb-4121-9c8c-394f390e40dc req-9138f5a7-16aa-4226-ad2b-cee0f8ad38bd service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:54.660639 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-2b8c8123-20eb-4121-9c8c-394f390e40dc req-9138f5a7-16aa-4226-ad2b-cee0f8ad38bd service nova] Creating event network-changed:4003555e-bf92-479e-b2dd-be6fe4500b56 for instance 916159e1-4580-4bb4-a78f-857e9e15c61b on hv-cinder-83697 Jun 20 14:53:54.669358 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-2b8c8123-20eb-4121-9c8c-394f390e40dc req-9138f5a7-16aa-4226-ad2b-cee0f8ad38bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041528 Jun 20 14:53:54.670465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 114/234] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:53:54.865015 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-54153e9f-8854-4a0a-a844-bb4abc2c60d0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:54.886431 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-54153e9f-8854-4a0a-a844-bb4abc2c60d0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 1.126540 Jun 20 14:53:54.891482 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 121/235] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:53 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:55.264154 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-096939a3-8fa3-4fbc-8be4-21b6ebef73d8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:55.264893 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-096939a3-8fa3-4fbc-8be4-21b6ebef73d8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:55.304851 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-096939a3-8fa3-4fbc-8be4-21b6ebef73d8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:55.308412 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-096939a3-8fa3-4fbc-8be4-21b6ebef73d8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:55.309575 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-096939a3-8fa3-4fbc-8be4-21b6ebef73d8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:55.310879 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-096939a3-8fa3-4fbc-8be4-21b6ebef73d8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:55.428859 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-145c09f6-7dc1-4cd5-bd06-c04dcc417ce8 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:55.429379 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-145c09f6-7dc1-4cd5-bd06-c04dcc417ce8 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:55.439622 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-145c09f6-7dc1-4cd5-bd06-c04dcc417ce8 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:55.440167 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-145c09f6-7dc1-4cd5-bd06-c04dcc417ce8 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:55.442291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-145c09f6-7dc1-4cd5-bd06-c04dcc417ce8 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:55.442871 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-145c09f6-7dc1-4cd5-bd06-c04dcc417ce8 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:55.499296 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-145c09f6-7dc1-4cd5-bd06-c04dcc417ce8 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Going to try to terminate instance {{(pid=123979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 14:53:55.706233 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-145c09f6-7dc1-4cd5-bd06-c04dcc417ce8 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 204 len: 0 microversion: 2.1 time: 0.281121 Jun 20 14:53:55.707315 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 122/236] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:53:55 2022] DELETE /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 14:53:55.713709 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-f419aa4e-acba-45c7-ba13-80223c331143 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b495f8d7-3575-47ec-934c-da3c81f55bf7"}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:53:55.715335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-f419aa4e-acba-45c7-ba13-80223c331143 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:55.723191 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f419aa4e-acba-45c7-ba13-80223c331143 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:55.723932 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f419aa4e-acba-45c7-ba13-80223c331143 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:55.725671 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f419aa4e-acba-45c7-ba13-80223c331143 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:55.726382 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f419aa4e-acba-45c7-ba13-80223c331143 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:55.731907 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-096939a3-8fa3-4fbc-8be4-21b6ebef73d8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:55.746532 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-096939a3-8fa3-4fbc-8be4-21b6ebef73d8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:55.748869 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-096939a3-8fa3-4fbc-8be4-21b6ebef73d8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:55.750969 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-096939a3-8fa3-4fbc-8be4-21b6ebef73d8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1408 microversion: 2.20 time: 0.507015 Jun 20 14:53:55.768123 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 115/237] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:53:55 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1408 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:53:55.784137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-dadb64dd-277d-40ca-a6b9-e693a4ddbb41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:55.786386 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-dadb64dd-277d-40ca-a6b9-e693a4ddbb41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:55.854426 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dadb64dd-277d-40ca-a6b9-e693a4ddbb41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:55.866225 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dadb64dd-277d-40ca-a6b9-e693a4ddbb41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:55.869669 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dadb64dd-277d-40ca-a6b9-e693a4ddbb41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:55.870325 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dadb64dd-277d-40ca-a6b9-e693a4ddbb41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:56.146202 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-dadb64dd-277d-40ca-a6b9-e693a4ddbb41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:56.154867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-dadb64dd-277d-40ca-a6b9-e693a4ddbb41 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1502 microversion: 2.1 time: 0.385473 Jun 20 14:53:56.155451 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 116/238] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:55 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1502 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:56.161756 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d02b8515-92e4-49cc-81f6-aa32c002b97c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:56.162748 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-d02b8515-92e4-49cc-81f6-aa32c002b97c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:56.170352 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d02b8515-92e4-49cc-81f6-aa32c002b97c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:56.170889 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d02b8515-92e4-49cc-81f6-aa32c002b97c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:56.171764 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d02b8515-92e4-49cc-81f6-aa32c002b97c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:56.172439 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d02b8515-92e4-49cc-81f6-aa32c002b97c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:56.368008 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d02b8515-92e4-49cc-81f6-aa32c002b97c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:56.378214 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d02b8515-92e4-49cc-81f6-aa32c002b97c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 0.221340 Jun 20 14:53:56.379827 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 117/239] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:56 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:56.770008 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-4e309818-b391-49f3-956b-b557660f3905 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:56.771639 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-4e309818-b391-49f3-956b-b557660f3905 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:56.781510 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e309818-b391-49f3-956b-b557660f3905 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:56.787513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e309818-b391-49f3-956b-b557660f3905 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:56.789176 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e309818-b391-49f3-956b-b557660f3905 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:56.790046 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e309818-b391-49f3-956b-b557660f3905 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:57.178760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-4e309818-b391-49f3-956b-b557660f3905 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:57.190317 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-4e309818-b391-49f3-956b-b557660f3905 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:57.193944 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-4e309818-b391-49f3-956b-b557660f3905 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:57.197435 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-4e309818-b391-49f3-956b-b557660f3905 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1408 microversion: 2.20 time: 0.432081 Jun 20 14:53:57.198279 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 118/240] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:53:56 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1408 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:53:57.208006 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f7278d29-8ed9-4c85-bc8a-3a23f12f21de tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:57.209058 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f7278d29-8ed9-4c85-bc8a-3a23f12f21de tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:57.223075 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f7278d29-8ed9-4c85-bc8a-3a23f12f21de tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:57.225733 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f7278d29-8ed9-4c85-bc8a-3a23f12f21de tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:57.226754 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f7278d29-8ed9-4c85-bc8a-3a23f12f21de tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:57.229681 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f7278d29-8ed9-4c85-bc8a-3a23f12f21de tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:57.407146 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f7278d29-8ed9-4c85-bc8a-3a23f12f21de tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:57.417388 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f7278d29-8ed9-4c85-bc8a-3a23f12f21de tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1502 microversion: 2.1 time: 0.217132 Jun 20 14:53:57.428214 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 119/241] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:57 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1502 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:57.434167 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-83f0261f-92c2-4408-8e3a-f5cf7ea8d633 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:57.435046 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-83f0261f-92c2-4408-8e3a-f5cf7ea8d633 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:57.443175 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-83f0261f-92c2-4408-8e3a-f5cf7ea8d633 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:57.444489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-83f0261f-92c2-4408-8e3a-f5cf7ea8d633 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:57.445525 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-83f0261f-92c2-4408-8e3a-f5cf7ea8d633 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:57.446167 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-83f0261f-92c2-4408-8e3a-f5cf7ea8d633 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:57.663217 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-83f0261f-92c2-4408-8e3a-f5cf7ea8d633 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:57.675113 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-83f0261f-92c2-4408-8e3a-f5cf7ea8d633 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 0.245482 Jun 20 14:53:57.676809 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 120/242] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:57 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:53:57.877836 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-f419aa4e-acba-45c7-ba13-80223c331143 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "POST /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.168211 Jun 20 14:53:57.880140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 123/243] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 14:53:55 2022] POST /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e/os-volume_attachments => generated 194 bytes in 2172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:53:58.217860 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-16a4c0c3-9cc4-4a9e-b631-1d300d0fc326 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:58.218519 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-16a4c0c3-9cc4-4a9e-b631-1d300d0fc326 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:58.230053 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-16a4c0c3-9cc4-4a9e-b631-1d300d0fc326 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:58.230506 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-16a4c0c3-9cc4-4a9e-b631-1d300d0fc326 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:58.235534 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-16a4c0c3-9cc4-4a9e-b631-1d300d0fc326 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:58.235989 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-16a4c0c3-9cc4-4a9e-b631-1d300d0fc326 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:58.437501 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e250c2df-9085-49b9-9679-8bf979822833 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:58.438755 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e250c2df-9085-49b9-9679-8bf979822833 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:58.447489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:58.448946 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=6 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:58.486369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e250c2df-9085-49b9-9679-8bf979822833 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:58.486369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e250c2df-9085-49b9-9679-8bf979822833 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:58.487025 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e250c2df-9085-49b9-9679-8bf979822833 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:58.487461 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e250c2df-9085-49b9-9679-8bf979822833 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:58.553061 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-16a4c0c3-9cc4-4a9e-b631-1d300d0fc326 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:58.566313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-16a4c0c3-9cc4-4a9e-b631-1d300d0fc326 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:58.568268 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-16a4c0c3-9cc4-4a9e-b631-1d300d0fc326 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:58.570914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-16a4c0c3-9cc4-4a9e-b631-1d300d0fc326 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1408 microversion: 2.20 time: 0.358255 Jun 20 14:53:58.584328 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 121/244] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:53:58 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1408 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:53:58.696645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-914a26c5-f57a-4440-9aae-205324b33184 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:58.697714 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-914a26c5-f57a-4440-9aae-205324b33184 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:58.729317 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-914a26c5-f57a-4440-9aae-205324b33184 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:58.751671 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-914a26c5-f57a-4440-9aae-205324b33184 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:58.752698 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-914a26c5-f57a-4440-9aae-205324b33184 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:58.758610 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-914a26c5-f57a-4440-9aae-205324b33184 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:58.889561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=12 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:59.179402 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e250c2df-9085-49b9-9679-8bf979822833 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:59.190816 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e250c2df-9085-49b9-9679-8bf979822833 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1502 microversion: 2.1 time: 0.758749 Jun 20 14:53:59.196425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 124/245] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:58 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1502 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:53:59.589120 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2a00a27a-ee81-4d68-9302-e0911e780dca tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:53:59.589737 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-2a00a27a-ee81-4d68-9302-e0911e780dca tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:53:59.601546 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2a00a27a-ee81-4d68-9302-e0911e780dca tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:59.602379 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2a00a27a-ee81-4d68-9302-e0911e780dca tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:59.612786 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2a00a27a-ee81-4d68-9302-e0911e780dca tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:53:59.613412 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2a00a27a-ee81-4d68-9302-e0911e780dca tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:53:59.889232 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-914a26c5-f57a-4440-9aae-205324b33184 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:53:59.927330 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-914a26c5-f57a-4440-9aae-205324b33184 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 1.236907 Jun 20 14:53:59.928444 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 122/246] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:53:58 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:54:00.218706 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ab0224da-5b81-459a-8712-1d91345592f7 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:00.219519 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ab0224da-5b81-459a-8712-1d91345592f7 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:00.238984 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ab0224da-5b81-459a-8712-1d91345592f7 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:00.241116 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ab0224da-5b81-459a-8712-1d91345592f7 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:00.244286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ab0224da-5b81-459a-8712-1d91345592f7 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:00.246272 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ab0224da-5b81-459a-8712-1d91345592f7 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:00.283964 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=100 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:00.316487 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-2a00a27a-ee81-4d68-9302-e0911e780dca tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:00.332380 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-2a00a27a-ee81-4d68-9302-e0911e780dca tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:00.338952 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-2a00a27a-ee81-4d68-9302-e0911e780dca tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:00.342860 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-2a00a27a-ee81-4d68-9302-e0911e780dca tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1408 microversion: 2.20 time: 0.757487 Jun 20 14:54:00.344024 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 125/247] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:53:59 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1408 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:54:00.607771 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ab0224da-5b81-459a-8712-1d91345592f7 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:00.627324 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ab0224da-5b81-459a-8712-1d91345592f7 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1502 microversion: 2.1 time: 0.417063 Jun 20 14:54:00.633187 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 123/248] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:00 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1502 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:00.828970 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-eef31f62-7d49-48ae-9ff1-ebf1b8da304f req-51650bba-a67d-4e8f-99f3-9f75a2e9fd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f72986c-e4c6-440b-97f9-4b5e7444f448", "name": "network-vif-deleted", "tag": "58d38709-d644-420a-adf0-6acafb161ee3"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:00.843920 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-eef31f62-7d49-48ae-9ff1-ebf1b8da304f req-51650bba-a67d-4e8f-99f3-9f75a2e9fd93 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:00.844364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-eef31f62-7d49-48ae-9ff1-ebf1b8da304f req-51650bba-a67d-4e8f-99f3-9f75a2e9fd93 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:00.900276 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-eef31f62-7d49-48ae-9ff1-ebf1b8da304f req-51650bba-a67d-4e8f-99f3-9f75a2e9fd93 service nova] Creating event network-vif-deleted:58d38709-d644-420a-adf0-6acafb161ee3 for instance 9f72986c-e4c6-440b-97f9-4b5e7444f448 on hv-cinder-83697 Jun 20 14:54:00.916603 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-eef31f62-7d49-48ae-9ff1-ebf1b8da304f req-51650bba-a67d-4e8f-99f3-9f75a2e9fd93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091805 Jun 20 14:54:00.917269 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 126/249] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:00.953275 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-002c7f74-af24-4078-bc22-1eec89fd69ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:00.954237 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-002c7f74-af24-4078-bc22-1eec89fd69ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:00.973692 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-002c7f74-af24-4078-bc22-1eec89fd69ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:00.976300 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-002c7f74-af24-4078-bc22-1eec89fd69ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:00.978809 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-002c7f74-af24-4078-bc22-1eec89fd69ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:00.980294 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-002c7f74-af24-4078-bc22-1eec89fd69ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:01.211178 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-002c7f74-af24-4078-bc22-1eec89fd69ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:01.222758 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-002c7f74-af24-4078-bc22-1eec89fd69ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 0.274813 Jun 20 14:54:01.223898 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 124/250] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:00 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:01.362869 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1999317d-a725-4d42-9f7b-3012886b5fd6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:01.363552 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-1999317d-a725-4d42-9f7b-3012886b5fd6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:01.371132 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1999317d-a725-4d42-9f7b-3012886b5fd6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:01.372062 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1999317d-a725-4d42-9f7b-3012886b5fd6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:01.372815 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1999317d-a725-4d42-9f7b-3012886b5fd6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:01.373392 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1999317d-a725-4d42-9f7b-3012886b5fd6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:01.619227 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-1999317d-a725-4d42-9f7b-3012886b5fd6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:01.622075 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:01.632853 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-1999317d-a725-4d42-9f7b-3012886b5fd6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:01.634926 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-1999317d-a725-4d42-9f7b-3012886b5fd6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:01.636539 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1999317d-a725-4d42-9f7b-3012886b5fd6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1408 microversion: 2.20 time: 0.278042 Jun 20 14:54:01.647746 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 127/251] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:54:01 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1408 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:54:01.650896 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-abe266d3-6e6a-4995-aa20-d0fdd6160753 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:01.661446 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-abe266d3-6e6a-4995-aa20-d0fdd6160753 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:01.666136 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-abe266d3-6e6a-4995-aa20-d0fdd6160753 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:01.666594 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-abe266d3-6e6a-4995-aa20-d0fdd6160753 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:01.667372 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-abe266d3-6e6a-4995-aa20-d0fdd6160753 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:01.667855 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-abe266d3-6e6a-4995-aa20-d0fdd6160753 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:01.730442 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-abe266d3-6e6a-4995-aa20-d0fdd6160753 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:01.732513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-abe266d3-6e6a-4995-aa20-d0fdd6160753 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:01.733525 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-abe266d3-6e6a-4995-aa20-d0fdd6160753 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lazy-loading 'fault' on Instance uuid 9f72986c-e4c6-440b-97f9-4b5e7444f448 {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:54:01.789769 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-abe266d3-6e6a-4995-aa20-d0fdd6160753 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a159cc0128485482851c885de78e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c461f88b7a00462c99532ec1262cb23c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:01.810418 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-abe266d3-6e6a-4995-aa20-d0fdd6160753 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 200 len: 1303 microversion: 2.1 time: 0.164060 Jun 20 14:54:01.813413 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 125/252] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:01 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 1303 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:02.240574 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-45ac1add-88a9-490a-bcb3-bdfc2516c0a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:02.241225 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-45ac1add-88a9-490a-bcb3-bdfc2516c0a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:02.253877 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-45ac1add-88a9-490a-bcb3-bdfc2516c0a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:02.254655 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-45ac1add-88a9-490a-bcb3-bdfc2516c0a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:02.255585 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-45ac1add-88a9-490a-bcb3-bdfc2516c0a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:02.256570 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-45ac1add-88a9-490a-bcb3-bdfc2516c0a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:02.459050 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-45ac1add-88a9-490a-bcb3-bdfc2516c0a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:02.467707 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-45ac1add-88a9-490a-bcb3-bdfc2516c0a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1502 microversion: 2.1 time: 0.231276 Jun 20 14:54:02.468282 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 128/253] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:02 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:02.491848 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-cb4345bf-7372-480b-8ca2-9af0c7b20e7a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46f436ea-94a1-4caf-ac68-46f2feb3d51c"}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:02.493233 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-cb4345bf-7372-480b-8ca2-9af0c7b20e7a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:02.500694 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cb4345bf-7372-480b-8ca2-9af0c7b20e7a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:02.501279 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cb4345bf-7372-480b-8ca2-9af0c7b20e7a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:02.502271 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cb4345bf-7372-480b-8ca2-9af0c7b20e7a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:02.502735 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cb4345bf-7372-480b-8ca2-9af0c7b20e7a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:02.537531 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-cb4345bf-7372-480b-8ca2-9af0c7b20e7a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] HTTP exception thrown: Cannot 'attach_volume' instance 80267d79-170a-4c4e-b7fe-dfff49c7f195 while it is in vm_state rescued Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-cb4345bf-7372-480b-8ca2-9af0c7b20e7a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Request method failure captured: Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: POST /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195/os-volume_attachments HTTP/1.1 Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 74 Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImcHJuSa1U2mDQw9Je2xMgVwCoBOENl4iMW3vovpnSsB3iLV2Wky6amoiYaxxO44qc2Z72Jit4az7ijT7wcCAZNHNcWZrT6z4FDrbh0ShQZbRnswOu_dl12QuYvC9Bxopa25pVc9jmSmMGQBHZ-89TuG0RSht7skWN3u3AnyB050GU Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: 1333ac4890624e11941a2681b51b07ab Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1970379770 Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:54:02.540137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:54:02.542712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1333ac4890624e11941a2681b51b07ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1333ac4890624e11941a2681b51b07ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1333ac4890624e11941a2681b51b07ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1333ac4890624e11941a2681b51b07ab"}]}] Jun 20 14:54:02.542712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1970379770 Jun 20 14:54:02.542712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: 1333ac4890624e11941a2681b51b07ab Jun 20 14:54:02.542712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1970379770 Jun 20 14:54:02.542712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-ServerRescueNegativeTestJSON-1970379770-project Jun 20 14:54:02.542712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:54:02.542712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:54:02.542712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: afc8379be09748a68ade6af9b99cdfa2 Jun 20 14:54:02.542712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1970379770-project Jun 20 14:54:02.542712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Jun 20 14:54:02.542712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {"volumeAttachment": {"volumeId": "46f436ea-94a1-4caf-ac68-46f2feb3d51c"}} Jun 20 14:54:02.542712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Cannot 'attach_volume' instance 80267d79-170a-4c4e-b7fe-dfff49c7f195 while it is in vm_state rescued Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'server_id': '80267d79-170a-4c4e-b7fe-dfff49c7f195', 'body': {'volumeAttachment': {'volumeId': '46f436ea-94a1-4caf-ac68-46f2feb3d51c'}}} Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80267d79-170a-4c4e-b7fe-dfff49c7f195 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:54:02.543460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 80267d79-170a-4c4e-b7fe-dfff49c7f195 while it is in vm_state rescued Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:54:02.544642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:54:02.545814 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:54:02.545814 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:54:02.545814 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 80267d79-170a-4c4e-b7fe-dfff49c7f195 while it is in vm_state rescued Jun 20 14:54:02.545814 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:54:02.545814 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-cb4345bf-7372-480b-8ca2-9af0c7b20e7a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Returning 409 to user: Cannot 'attach_volume' instance 80267d79-170a-4c4e-b7fe-dfff49c7f195 while it is in vm_state rescued {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:54:02.545814 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-cb4345bf-7372-480b-8ca2-9af0c7b20e7a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "POST /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.060952 Jun 20 14:54:02.545814 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 126/254] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 14:54:02 2022] POST /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 14:54:02.555482 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-a96f927c-c104-4512-a0e8-049f98d24670 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:02.556030 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-a96f927c-c104-4512-a0e8-049f98d24670 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:02.563758 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a96f927c-c104-4512-a0e8-049f98d24670 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:02.564607 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a96f927c-c104-4512-a0e8-049f98d24670 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:02.570277 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a96f927c-c104-4512-a0e8-049f98d24670 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:02.570936 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a96f927c-c104-4512-a0e8-049f98d24670 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:02.652048 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-a96f927c-c104-4512-a0e8-049f98d24670 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "POST /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195/action" status: 202 len: 0 microversion: 2.1 time: 0.103204 Jun 20 14:54:02.653223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 129/255] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 14:54:02 2022] POST /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 14:54:02.656092 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-595504c1-66da-48fc-bda8-0a475605db3d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:02.658194 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-595504c1-66da-48fc-bda8-0a475605db3d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:02.666095 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-595504c1-66da-48fc-bda8-0a475605db3d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:02.666930 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-595504c1-66da-48fc-bda8-0a475605db3d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:02.667926 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-595504c1-66da-48fc-bda8-0a475605db3d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:02.668595 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-595504c1-66da-48fc-bda8-0a475605db3d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:02.674322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-572fc903-7134-4510-9f29-0f1e4e0cffd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:02.677455 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-572fc903-7134-4510-9f29-0f1e4e0cffd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:02.708870 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-572fc903-7134-4510-9f29-0f1e4e0cffd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:02.709581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-572fc903-7134-4510-9f29-0f1e4e0cffd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:02.712283 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-572fc903-7134-4510-9f29-0f1e4e0cffd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:02.712950 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-572fc903-7134-4510-9f29-0f1e4e0cffd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:03.069764 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-595504c1-66da-48fc-bda8-0a475605db3d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:03.089197 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-595504c1-66da-48fc-bda8-0a475605db3d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:03.090755 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-595504c1-66da-48fc-bda8-0a475605db3d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:03.092236 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-595504c1-66da-48fc-bda8-0a475605db3d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1408 microversion: 2.20 time: 0.440661 Jun 20 14:54:03.096159 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 127/256] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:54:02 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1408 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:54:03.101620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3df82a56-7493-4b5f-8dcb-29560a47af85 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:03.113114 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-572fc903-7134-4510-9f29-0f1e4e0cffd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:03.117927 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-3df82a56-7493-4b5f-8dcb-29560a47af85 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] [instance: 9f72986c-e4c6-440b-97f9-4b5e7444f448] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:03.122380 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-572fc903-7134-4510-9f29-0f1e4e0cffd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1510 microversion: 2.1 time: 0.454187 Jun 20 14:54:03.126059 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 130/257] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:02 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1510 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:03.129677 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3df82a56-7493-4b5f-8dcb-29560a47af85 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:03.130296 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3df82a56-7493-4b5f-8dcb-29560a47af85 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:03.131225 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3df82a56-7493-4b5f-8dcb-29560a47af85 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:03.131794 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3df82a56-7493-4b5f-8dcb-29560a47af85 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:03.161230 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-3df82a56-7493-4b5f-8dcb-29560a47af85 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] HTTP exception thrown: Instance 9f72986c-e4c6-440b-97f9-4b5e7444f448 could not be found. Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3df82a56-7493-4b5f-8dcb-29560a47af85 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Request method failure captured: Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 HTTP/1.1 Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisInKVe9mekttSINE3KqEBHoKS1CculmJRr2j04GKdBY7274Ny8_yS3TYfa9wALfDA6tcFIlTQAbU-ld3bwze_N7LVX_q7SUmr6crYtVzMel-zb5IVKSr4OqVzAk23nVqX-PvmnL7bK5990IWRB8YRDX31hTr7JCENIicy3ZuuZXFOFI Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: c461f88b7a00462c99532ec1262cb23c Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-VolumesActionsTest-834626655 Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:54:03.162789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:54:03.164103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c461f88b7a00462c99532ec1262cb23c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c461f88b7a00462c99532ec1262cb23c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c461f88b7a00462c99532ec1262cb23c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c461f88b7a00462c99532ec1262cb23c"}]}] Jun 20 14:54:03.164103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-VolumesActionsTest-834626655 Jun 20 14:54:03.164103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: c461f88b7a00462c99532ec1262cb23c Jun 20 14:54:03.164103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-VolumesActionsTest-834626655 Jun 20 14:54:03.164103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-VolumesActionsTest-834626655-project Jun 20 14:54:03.164103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:54:03.164103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:54:03.164103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: a4a159cc0128485482851c885de78e5d Jun 20 14:54:03.164103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-VolumesActionsTest-834626655-project Jun 20 14:54:03.164103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:54:03.164103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance 9f72986c-e4c6-440b-97f9-4b5e7444f448 could not be found. Jun 20 14:54:03.164103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': '9f72986c-e4c6-440b-97f9-4b5e7444f448'} Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f72986c-e4c6-440b-97f9-4b5e7444f448 could not be found. Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:54:03.164864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f72986c-e4c6-440b-97f9-4b5e7444f448 could not be found. Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f72986c-e4c6-440b-97f9-4b5e7444f448 could not be found. Jun 20 14:54:03.166041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:54:03.167118 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3df82a56-7493-4b5f-8dcb-29560a47af85 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] Returning 404 to user: Instance 9f72986c-e4c6-440b-97f9-4b5e7444f448 could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:54:03.167118 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-3df82a56-7493-4b5f-8dcb-29560a47af85 tempest-VolumesActionsTest-834626655 tempest-VolumesActionsTest-834626655-project] 10.222.0.23 "GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448" status: 404 len: 111 microversion: 2.1 time: 0.066665 Jun 20 14:54:03.167118 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 128/258] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:03 2022] GET /compute/v2.1/servers/9f72986c-e4c6-440b-97f9-4b5e7444f448 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:54:03.259839 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-8619f77e-6cb9-41dd-a27e-353923a9b32b req-29995ca4-13ec-4ca0-bcf8-1f80825e4bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916159e1-4580-4bb4-a78f-857e9e15c61b", "name": "network-vif-plugged", "status": "completed", "tag": "4003555e-bf92-479e-b2dd-be6fe4500b56"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:03.274777 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-8619f77e-6cb9-41dd-a27e-353923a9b32b req-29995ca4-13ec-4ca0-bcf8-1f80825e4bf0 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:03.275488 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-8619f77e-6cb9-41dd-a27e-353923a9b32b req-29995ca4-13ec-4ca0-bcf8-1f80825e4bf0 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:03.292196 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-8619f77e-6cb9-41dd-a27e-353923a9b32b req-29995ca4-13ec-4ca0-bcf8-1f80825e4bf0 service nova] Creating event network-vif-plugged:4003555e-bf92-479e-b2dd-be6fe4500b56 for instance 916159e1-4580-4bb4-a78f-857e9e15c61b on hv-cinder-83697 Jun 20 14:54:03.300868 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-8619f77e-6cb9-41dd-a27e-353923a9b32b req-29995ca4-13ec-4ca0-bcf8-1f80825e4bf0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045224 Jun 20 14:54:03.302597 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 131/259] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:04.112250 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-12baddcc-a61d-4ba7-8f3a-54d3e0f676df tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:04.112996 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-12baddcc-a61d-4ba7-8f3a-54d3e0f676df tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:04.125665 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-12baddcc-a61d-4ba7-8f3a-54d3e0f676df tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:04.126129 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-12baddcc-a61d-4ba7-8f3a-54d3e0f676df tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:04.126908 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-12baddcc-a61d-4ba7-8f3a-54d3e0f676df tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:04.127335 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-12baddcc-a61d-4ba7-8f3a-54d3e0f676df tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:04.142431 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0bd0871d-263e-4dd9-856d-ea9eb6df156a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:04.143130 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-0bd0871d-263e-4dd9-856d-ea9eb6df156a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:04.151952 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0bd0871d-263e-4dd9-856d-ea9eb6df156a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:04.152444 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0bd0871d-263e-4dd9-856d-ea9eb6df156a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:04.153311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0bd0871d-263e-4dd9-856d-ea9eb6df156a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:04.153752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0bd0871d-263e-4dd9-856d-ea9eb6df156a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:04.351499 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0bd0871d-263e-4dd9-856d-ea9eb6df156a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:04.360121 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0bd0871d-263e-4dd9-856d-ea9eb6df156a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1510 microversion: 2.1 time: 0.221956 Jun 20 14:54:04.365578 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 132/260] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:04 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:04.419538 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-12baddcc-a61d-4ba7-8f3a-54d3e0f676df tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:04.433538 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-12baddcc-a61d-4ba7-8f3a-54d3e0f676df tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:04.435360 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-12baddcc-a61d-4ba7-8f3a-54d3e0f676df tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:04.436867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-12baddcc-a61d-4ba7-8f3a-54d3e0f676df tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1408 microversion: 2.20 time: 0.329431 Jun 20 14:54:04.440495 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 129/261] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:54:04 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1408 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:54:05.378785 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-a1a244ab-b7db-4290-847e-15c6fc1cebc0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:05.380301 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-a1a244ab-b7db-4290-847e-15c6fc1cebc0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:05.387387 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a1a244ab-b7db-4290-847e-15c6fc1cebc0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:05.387839 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a1a244ab-b7db-4290-847e-15c6fc1cebc0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:05.394262 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a1a244ab-b7db-4290-847e-15c6fc1cebc0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:05.398943 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a1a244ab-b7db-4290-847e-15c6fc1cebc0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:05.460040 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7bc64096-999d-4e00-9339-c4e5e2e8f37f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:05.460680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7bc64096-999d-4e00-9339-c4e5e2e8f37f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:05.469551 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7bc64096-999d-4e00-9339-c4e5e2e8f37f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:05.471039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7bc64096-999d-4e00-9339-c4e5e2e8f37f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:05.475309 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7bc64096-999d-4e00-9339-c4e5e2e8f37f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:05.476765 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7bc64096-999d-4e00-9339-c4e5e2e8f37f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:05.588793 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a1a244ab-b7db-4290-847e-15c6fc1cebc0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:05.597572 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-a1a244ab-b7db-4290-847e-15c6fc1cebc0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1510 microversion: 2.1 time: 0.223038 Jun 20 14:54:05.601427 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 133/262] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:05 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:05.669306 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-7bc64096-999d-4e00-9339-c4e5e2e8f37f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:05.679100 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-7bc64096-999d-4e00-9339-c4e5e2e8f37f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:05.680818 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-7bc64096-999d-4e00-9339-c4e5e2e8f37f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:05.682260 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7bc64096-999d-4e00-9339-c4e5e2e8f37f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1600 microversion: 2.20 time: 0.226702 Jun 20 14:54:05.683587 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 130/263] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:54:05 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1600 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:54:05.702896 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6927f767-68ff-4cc4-b196-9efe495a6c36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:05.705742 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-6927f767-68ff-4cc4-b196-9efe495a6c36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:05.724573 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6927f767-68ff-4cc4-b196-9efe495a6c36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:05.725264 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6927f767-68ff-4cc4-b196-9efe495a6c36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:05.726220 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6927f767-68ff-4cc4-b196-9efe495a6c36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:05.726811 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6927f767-68ff-4cc4-b196-9efe495a6c36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:05.866996 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6927f767-68ff-4cc4-b196-9efe495a6c36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.167812 Jun 20 14:54:05.883495 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 134/264] 10.222.0.23 () {60 vars in 1315 bytes} [Mon Jun 20 14:54:05 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:54:06.617826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-686d97f0-219e-4d4c-90c2-ebff129b0cb2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:06.618441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-686d97f0-219e-4d4c-90c2-ebff129b0cb2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:06.631771 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-686d97f0-219e-4d4c-90c2-ebff129b0cb2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:06.632528 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-686d97f0-219e-4d4c-90c2-ebff129b0cb2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:06.633363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-686d97f0-219e-4d4c-90c2-ebff129b0cb2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:06.634120 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-686d97f0-219e-4d4c-90c2-ebff129b0cb2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:06.891139 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-686d97f0-219e-4d4c-90c2-ebff129b0cb2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:06.899200 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-686d97f0-219e-4d4c-90c2-ebff129b0cb2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1510 microversion: 2.1 time: 0.285913 Jun 20 14:54:06.912943 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 131/265] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:06 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1510 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:07.457797 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-cd79e054-0abf-425b-a7da-566bb25062d2 req-4c27a122-dfa6-4cbf-9d43-9c5d0901a21b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "916159e1-4580-4bb4-a78f-857e9e15c61b", "tag": "4003555e-bf92-479e-b2dd-be6fe4500b56"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:07.469853 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-cd79e054-0abf-425b-a7da-566bb25062d2 req-4c27a122-dfa6-4cbf-9d43-9c5d0901a21b service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:07.470712 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-cd79e054-0abf-425b-a7da-566bb25062d2 req-4c27a122-dfa6-4cbf-9d43-9c5d0901a21b service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:07.487751 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-cd79e054-0abf-425b-a7da-566bb25062d2 req-4c27a122-dfa6-4cbf-9d43-9c5d0901a21b service nova] Creating event network-changed:4003555e-bf92-479e-b2dd-be6fe4500b56 for instance 916159e1-4580-4bb4-a78f-857e9e15c61b on hv-cinder-83697 Jun 20 14:54:07.494970 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-cd79e054-0abf-425b-a7da-566bb25062d2 req-4c27a122-dfa6-4cbf-9d43-9c5d0901a21b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043087 Jun 20 14:54:07.510751 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 135/266] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:07.940450 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-48f00f3e-9ee0-48fa-855e-bdd01a55ddcf tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:07.943387 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-48f00f3e-9ee0-48fa-855e-bdd01a55ddcf tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:08.005689 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-48f00f3e-9ee0-48fa-855e-bdd01a55ddcf tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:08.006541 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-48f00f3e-9ee0-48fa-855e-bdd01a55ddcf tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:08.007772 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-48f00f3e-9ee0-48fa-855e-bdd01a55ddcf tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:08.009053 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-48f00f3e-9ee0-48fa-855e-bdd01a55ddcf tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:08.362800 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-48f00f3e-9ee0-48fa-855e-bdd01a55ddcf tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:08.372284 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-48f00f3e-9ee0-48fa-855e-bdd01a55ddcf tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1516 microversion: 2.1 time: 0.459393 Jun 20 14:54:08.385547 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 132/267] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:07 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1516 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:09.126280 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b6b3884f-1e82-405c-b3ae-82358a735b7f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Action: 'create', calling method: .version_select at 0x7fce513a04c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1900870198", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvrKg6n4SPinuNyTJZjK9jytXdCW4djUSx/79MIW6cBVw9RCKS1nViFD2wW5Tved1+oFHgcqGthKtlQM/nMY2BvMQfkAVbajm1o8FcAMGBBluB6VYhWp1GJihSODEdiTQ=="}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:09.161113 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-b6b3884f-1e82-405c-b3ae-82358a735b7f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Getting quotas for project 7500725f7c744f318862323e13c5f23e. Resources: {'key_pairs'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:54:09.167594 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-b6b3884f-1e82-405c-b3ae-82358a735b7f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Getting quotas for user ad9a7c6755784828b967f1bef37f6441 and project 7500725f7c744f318862323e13c5f23e. Resources: {'key_pairs'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:54:09.245814 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-b6b3884f-1e82-405c-b3ae-82358a735b7f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.124436 Jun 20 14:54:09.247234 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 136/268] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 14:54:09 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:09.397169 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b83020ae-c64b-4cf2-bdfb-38dd55ed9d41 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Action: 'create', calling method: .version_select at 0x7fce50ba6ca0>, body: {"keypair": {"name": "tempest-keypair-1832732822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPeeRlKAyPvGsr3QOslhSpIAYn8KBGsdnLvDWzP6DBesvQQOnXQY4wv2/j34ggFrxpPkSrtKqIoUzgDnUeb8MWhM9UaybNvEbwdekwtPoFg1dYTPKiQYtbK6W4XiS8lTQ=="}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:09.439975 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1594265557", "imageRef": "c8d32ce6-c4f1-41a9-b872-9d690dfac1fe", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1900870198", "networks": [{"uuid": "99ae49b1-4209-43ab-a443-be5d8d242625"}]}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:09.441415 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-b83020ae-c64b-4cf2-bdfb-38dd55ed9d41 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'key_pairs'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:54:09.447874 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-b83020ae-c64b-4cf2-bdfb-38dd55ed9d41 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for user 87c3f39c0bed4fadbc8a556c857baf4a and project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'key_pairs'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:54:09.480205 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b83020ae-c64b-4cf2-bdfb-38dd55ed9d41 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.086883 Jun 20 14:54:09.480809 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 133/269] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 14:54:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:09.522172 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.network.neutron [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] validate_networks() for [('99ae49b1-4209-43ab-a443-be5d8d242625', None, None, None, None, None)] {{(pid=123979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:54:10.043044 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Flavor limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:54:10.043044 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Image limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:54:10.043044 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Flavor pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:54:10.043044 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Image pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:54:10.043044 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:54:10.051655 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:10.052220 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:10.053064 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:10.053495 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:10.076921 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Getting quotas for project 7500725f7c744f318862323e13c5f23e. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:54:10.081710 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Getting quotas for user ad9a7c6755784828b967f1bef37f6441 and project 7500725f7c744f318862323e13c5f23e. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:54:10.094227 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Going to run 1 instances... {{(pid=123979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:54:10.096758 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8d32ce6-c4f1-41a9-b872-9d690dfac1fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:54:10.108847 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:10.157147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6a742e99-20e9-4eb7-ba96-9ad573ec347d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721756 Jun 20 14:54:10.163892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 137/270] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 14:54:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 14:54:10.169482 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-de68ca47-3d8f-4e92-a43a-8022c52e79e0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:10.170365 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-de68ca47-3d8f-4e92-a43a-8022c52e79e0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:10.267280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-de68ca47-3d8f-4e92-a43a-8022c52e79e0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:10.280375 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-de68ca47-3d8f-4e92-a43a-8022c52e79e0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1259 microversion: 2.1 time: 0.115389 Jun 20 14:54:10.296501 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 134/271] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:10 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1259 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:54:10.298347 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ecb466cc-69e3-40ef-bcdf-9a2234f1b478 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Action: 'create', calling method: .version_select at 0x7fce513f71f0>, body: {"keypair": {"name": "tempest-keypair-2104789537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZysovsj3T2fWvF+RGo2FMauRQ1OH8rFwPOuidsssgNXRjndXLsULIm4tTt/hWmTiXo8UDqTgBBPv7NHj+nGD/6cE6y8TLcc3iV+4Uq8xbebrBARfuwvr6pVlhSQ5BWUA=="}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:10.324425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-ecb466cc-69e3-40ef-bcdf-9a2234f1b478 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Getting quotas for project 1333ac4890624e11941a2681b51b07ab. Resources: {'key_pairs'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:54:10.329804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-ecb466cc-69e3-40ef-bcdf-9a2234f1b478 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Getting quotas for user afc8379be09748a68ade6af9b99cdfa2 and project 1333ac4890624e11941a2681b51b07ab. Resources: {'key_pairs'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:54:10.376183 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ecb466cc-69e3-40ef-bcdf-9a2234f1b478 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087104 Jun 20 14:54:10.377395 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 138/272] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 14:54:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:11.301332 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f5ea9863-83bc-4eff-8599-b96b7fc29605 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:11.303463 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f5ea9863-83bc-4eff-8599-b96b7fc29605 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:11.311158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f5ea9863-83bc-4eff-8599-b96b7fc29605 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:11.311774 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f5ea9863-83bc-4eff-8599-b96b7fc29605 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:11.312732 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f5ea9863-83bc-4eff-8599-b96b7fc29605 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:11.313623 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f5ea9863-83bc-4eff-8599-b96b7fc29605 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:11.411555 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f5ea9863-83bc-4eff-8599-b96b7fc29605 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:11.420493 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f5ea9863-83bc-4eff-8599-b96b7fc29605 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1263 microversion: 2.1 time: 0.123027 Jun 20 14:54:11.421962 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 135/273] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:11 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1263 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:11.469867 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-678467886", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2b22871-0b88-408a-81b6-567b6c78e97d"}], "security_groups": [{"name": "tempest-securitygroup--1988582582"}], "key_name": "tempest-keypair-1832732822", "user_data": "}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:11.656937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.network.neutron [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] validate_networks() for [('b2b22871-0b88-408a-81b6-567b6c78e97d', None, None, None, None, None)] {{(pid=123979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:54:12.441155 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-98de5431-b400-420a-8ac6-850c9a2054d6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:12.443376 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-98de5431-b400-420a-8ac6-850c9a2054d6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:12.447312 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:12.454664 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-98de5431-b400-420a-8ac6-850c9a2054d6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:12.455248 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-98de5431-b400-420a-8ac6-850c9a2054d6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:12.456287 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-98de5431-b400-420a-8ac6-850c9a2054d6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:12.456942 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-98de5431-b400-420a-8ac6-850c9a2054d6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:12.479244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Flavor limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:54:12.479767 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Image limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:54:12.480739 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Flavor pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:54:12.481101 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Image pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:54:12.481603 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:54:12.495923 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:12.496485 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:12.497305 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:12.497729 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:12.518372 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:54:12.522727 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for user 87c3f39c0bed4fadbc8a556c857baf4a and project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:54:12.548321 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Going to run 1 instances... {{(pid=123979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:54:12.552738 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-98de5431-b400-420a-8ac6-850c9a2054d6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:12.557142 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:54:12.560424 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-98de5431-b400-420a-8ac6-850c9a2054d6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1255 microversion: 2.1 time: 0.124049 Jun 20 14:54:12.561410 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 136/274] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:12 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1255 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:12.599720 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1947374906", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7525c8ce-ba0d-41dc-84d9-0e995f7e941d"}], "security_groups": [{"name": "tempest-securitygroup--1137622421"}], "key_name": "tempest-keypair-2104789537", "user_data": "}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:12.641020 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-850a5370-bb4e-4e5e-85e6-fd3e265fb122 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.176016 Jun 20 14:54:12.641864 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 139/275] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 14:54:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 14:54:12.652078 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-62ae27fc-617a-4d9b-9592-4a511e8396df tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:12.652695 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-62ae27fc-617a-4d9b-9592-4a511e8396df tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:12.711988 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-62ae27fc-617a-4d9b-9592-4a511e8396df tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:12.720958 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-62ae27fc-617a-4d9b-9592-4a511e8396df tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1241 microversion: 2.1 time: 0.072891 Jun 20 14:54:12.721854 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 140/276] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:12 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:54:12.736470 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.network.neutron [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] validate_networks() for [('7525c8ce-ba0d-41dc-84d9-0e995f7e941d', None, None, None, None, None)] {{(pid=123978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:54:13.260869 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Flavor limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:54:13.261283 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Image limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:54:13.261762 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Flavor pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:54:13.262151 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Image pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:54:13.262618 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:54:13.273325 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:13.273606 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:13.274599 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:13.275280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:13.294340 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Getting quotas for project 1333ac4890624e11941a2681b51b07ab. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:54:13.299331 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Getting quotas for user afc8379be09748a68ade6af9b99cdfa2 and project 1333ac4890624e11941a2681b51b07ab. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:54:13.318265 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Going to run 1 instances... {{(pid=123978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:54:13.320690 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:54:13.372616 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-35fe7bdb-59c5-49c6-bb14-64a53f13a1f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.778458 Jun 20 14:54:13.373613 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 137/277] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 14:54:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 14:54:13.383426 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ba6dda36-a662-4028-8c3c-7e9cea8d3d3e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:13.384029 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ba6dda36-a662-4028-8c3c-7e9cea8d3d3e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:13.473425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ba6dda36-a662-4028-8c3c-7e9cea8d3d3e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:13.485491 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ba6dda36-a662-4028-8c3c-7e9cea8d3d3e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1246 microversion: 2.1 time: 0.105398 Jun 20 14:54:13.496054 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 141/278] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:13 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1246 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:13.577916 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ec3daefe-e5c0-4640-bf75-fdb1363815d0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:13.578617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ec3daefe-e5c0-4640-bf75-fdb1363815d0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:13.590592 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ec3daefe-e5c0-4640-bf75-fdb1363815d0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:13.591036 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ec3daefe-e5c0-4640-bf75-fdb1363815d0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:13.592407 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ec3daefe-e5c0-4640-bf75-fdb1363815d0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:13.593235 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ec3daefe-e5c0-4640-bf75-fdb1363815d0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:13.708550 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ec3daefe-e5c0-4640-bf75-fdb1363815d0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:13.731878 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ec3daefe-e5c0-4640-bf75-fdb1363815d0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1317 microversion: 2.1 time: 0.157739 Jun 20 14:54:13.738252 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9483f578-09d3-4902-b715-c1278cd4bd51 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:13.739343 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9483f578-09d3-4902-b715-c1278cd4bd51 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:13.747169 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 138/279] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:13 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:13.752494 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9483f578-09d3-4902-b715-c1278cd4bd51 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:13.753265 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9483f578-09d3-4902-b715-c1278cd4bd51 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:13.754663 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9483f578-09d3-4902-b715-c1278cd4bd51 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:13.755183 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9483f578-09d3-4902-b715-c1278cd4bd51 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:13.940243 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9483f578-09d3-4902-b715-c1278cd4bd51 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:13.949642 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9483f578-09d3-4902-b715-c1278cd4bd51 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1301 microversion: 2.1 time: 0.215887 Jun 20 14:54:13.954523 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 142/280] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:13 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1301 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:14.503100 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-90ba7ec9-b2ad-4515-8567-78da8765b460 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:14.503858 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-90ba7ec9-b2ad-4515-8567-78da8765b460 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:14.513095 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-90ba7ec9-b2ad-4515-8567-78da8765b460 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:14.518502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-90ba7ec9-b2ad-4515-8567-78da8765b460 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:14.526718 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-90ba7ec9-b2ad-4515-8567-78da8765b460 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:14.527260 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-90ba7ec9-b2ad-4515-8567-78da8765b460 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:14.764600 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-bd840a68-3bc6-4c23-9f8b-b8735b872fc3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:14.765363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-90ba7ec9-b2ad-4515-8567-78da8765b460 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:14.768795 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-bd840a68-3bc6-4c23-9f8b-b8735b872fc3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:14.781507 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-90ba7ec9-b2ad-4515-8567-78da8765b460 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1242 microversion: 2.1 time: 0.282640 Jun 20 14:54:14.785226 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bd840a68-3bc6-4c23-9f8b-b8735b872fc3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:14.798203 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 139/281] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:14 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1242 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:14.798983 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bd840a68-3bc6-4c23-9f8b-b8735b872fc3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:14.799939 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bd840a68-3bc6-4c23-9f8b-b8735b872fc3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:14.803586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bd840a68-3bc6-4c23-9f8b-b8735b872fc3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:14.974718 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c2fc64cf-25c4-46ee-9dfa-5a9869c3f3e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:14.975807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-c2fc64cf-25c4-46ee-9dfa-5a9869c3f3e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:14.991623 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c2fc64cf-25c4-46ee-9dfa-5a9869c3f3e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:14.992445 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c2fc64cf-25c4-46ee-9dfa-5a9869c3f3e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:14.995168 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c2fc64cf-25c4-46ee-9dfa-5a9869c3f3e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:14.996145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c2fc64cf-25c4-46ee-9dfa-5a9869c3f3e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:15.387509 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-bd840a68-3bc6-4c23-9f8b-b8735b872fc3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:15.408373 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-bd840a68-3bc6-4c23-9f8b-b8735b872fc3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.647384 Jun 20 14:54:15.431890 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 143/282] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:14 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:54:15.595918 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-c2fc64cf-25c4-46ee-9dfa-5a9869c3f3e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:15.616491 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-c2fc64cf-25c4-46ee-9dfa-5a9869c3f3e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1299 microversion: 2.1 time: 0.644996 Jun 20 14:54:15.620307 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 140/283] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:14 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1299 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:54:15.807270 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ec28f902-dc65-4934-997e-e73d60fcc433 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:15.808689 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ec28f902-dc65-4934-997e-e73d60fcc433 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:15.828639 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ec28f902-dc65-4934-997e-e73d60fcc433 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:15.829541 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ec28f902-dc65-4934-997e-e73d60fcc433 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:15.830594 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ec28f902-dc65-4934-997e-e73d60fcc433 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:15.831349 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ec28f902-dc65-4934-997e-e73d60fcc433 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:16.118845 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ec28f902-dc65-4934-997e-e73d60fcc433 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:16.132133 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ec28f902-dc65-4934-997e-e73d60fcc433 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1316 microversion: 2.1 time: 0.333211 Jun 20 14:54:16.136072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 144/284] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:15 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1316 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:16.440253 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ec60d1dd-1d4c-407e-8b2a-8414a09bacab tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:16.440959 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ec60d1dd-1d4c-407e-8b2a-8414a09bacab tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:16.453388 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ec60d1dd-1d4c-407e-8b2a-8414a09bacab tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:16.456839 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ec60d1dd-1d4c-407e-8b2a-8414a09bacab tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:16.457985 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ec60d1dd-1d4c-407e-8b2a-8414a09bacab tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:16.460157 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ec60d1dd-1d4c-407e-8b2a-8414a09bacab tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:16.637978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-5bb88e2d-9838-45c3-9d7b-d5bf449db10c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:16.638967 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-5bb88e2d-9838-45c3-9d7b-d5bf449db10c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:16.664836 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5bb88e2d-9838-45c3-9d7b-d5bf449db10c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:16.673202 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5bb88e2d-9838-45c3-9d7b-d5bf449db10c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:16.679215 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5bb88e2d-9838-45c3-9d7b-d5bf449db10c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:16.679817 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5bb88e2d-9838-45c3-9d7b-d5bf449db10c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:17.202091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-5bb88e2d-9838-45c3-9d7b-d5bf449db10c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:17.210566 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-5bb88e2d-9838-45c3-9d7b-d5bf449db10c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.578704 Jun 20 14:54:17.222724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 145/285] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:16 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:17.238891 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-1ddeb85b-80c8-4e9b-b895-6bef87a26906 req-b3ac594e-0c28-4056-81bd-8912bfd3843b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e28018-9057-44e5-a730-871114cf6249", "tag": "6ee3c9d3-8185-4e24-b29a-20f7ceb97549"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:17.255224 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-1ddeb85b-80c8-4e9b-b895-6bef87a26906 req-b3ac594e-0c28-4056-81bd-8912bfd3843b service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:17.259835 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-1ddeb85b-80c8-4e9b-b895-6bef87a26906 req-b3ac594e-0c28-4056-81bd-8912bfd3843b service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:17.458885 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ec60d1dd-1d4c-407e-8b2a-8414a09bacab tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:17.483194 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ec60d1dd-1d4c-407e-8b2a-8414a09bacab tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 1.047024 Jun 20 14:54:17.504106 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 141/286] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:16 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:17.532450 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-39056a04-904b-4e2e-a73c-fb9e619043c7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:17.533268 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-39056a04-904b-4e2e-a73c-fb9e619043c7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:17.577503 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-39056a04-904b-4e2e-a73c-fb9e619043c7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:17.580241 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-39056a04-904b-4e2e-a73c-fb9e619043c7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:17.581853 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-39056a04-904b-4e2e-a73c-fb9e619043c7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:17.585937 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-39056a04-904b-4e2e-a73c-fb9e619043c7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:17.646766 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-1ddeb85b-80c8-4e9b-b895-6bef87a26906 req-b3ac594e-0c28-4056-81bd-8912bfd3843b service nova] Creating event network-changed:6ee3c9d3-8185-4e24-b29a-20f7ceb97549 for instance 33e28018-9057-44e5-a730-871114cf6249 on hv-cinder-83697 Jun 20 14:54:17.657445 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-1ddeb85b-80c8-4e9b-b895-6bef87a26906 req-b3ac594e-0c28-4056-81bd-8912bfd3843b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.428982 Jun 20 14:54:17.660236 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 146/287] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:17.907795 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-39056a04-904b-4e2e-a73c-fb9e619043c7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:17.928024 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-39056a04-904b-4e2e-a73c-fb9e619043c7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1304 microversion: 2.1 time: 0.417708 Jun 20 14:54:17.929949 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 142/288] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:17 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1304 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:18.237632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-77810c43-ab67-4c8f-aeac-4a40542d91fb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:18.238529 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-77810c43-ab67-4c8f-aeac-4a40542d91fb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:18.259067 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-77810c43-ab67-4c8f-aeac-4a40542d91fb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:18.261058 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-77810c43-ab67-4c8f-aeac-4a40542d91fb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:18.263206 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-77810c43-ab67-4c8f-aeac-4a40542d91fb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:18.266366 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-77810c43-ab67-4c8f-aeac-4a40542d91fb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:18.506208 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6f028c11-52bd-43a6-bd96-d7ef8dae18c9 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:18.507022 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6f028c11-52bd-43a6-bd96-d7ef8dae18c9 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:18.521452 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6f028c11-52bd-43a6-bd96-d7ef8dae18c9 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:18.522018 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6f028c11-52bd-43a6-bd96-d7ef8dae18c9 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:18.527279 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6f028c11-52bd-43a6-bd96-d7ef8dae18c9 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:18.527964 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6f028c11-52bd-43a6-bd96-d7ef8dae18c9 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:18.567261 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=100 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:18.700569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-77810c43-ab67-4c8f-aeac-4a40542d91fb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:18.714984 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-77810c43-ab67-4c8f-aeac-4a40542d91fb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.486257 Jun 20 14:54:18.728068 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 147/289] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:18 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:18.955350 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-dc83dd46-db8a-4400-8ebc-13a23a730056 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:18.956268 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-dc83dd46-db8a-4400-8ebc-13a23a730056 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:18.964512 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dc83dd46-db8a-4400-8ebc-13a23a730056 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:18.965203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dc83dd46-db8a-4400-8ebc-13a23a730056 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:18.966181 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dc83dd46-db8a-4400-8ebc-13a23a730056 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:18.966775 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dc83dd46-db8a-4400-8ebc-13a23a730056 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:19.461868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-6f028c11-52bd-43a6-bd96-d7ef8dae18c9 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:19.471311 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6f028c11-52bd-43a6-bd96-d7ef8dae18c9 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.968987 Jun 20 14:54:19.486318 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 143/290] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:18 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:19.491817 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-e2637c0a-c677-4429-870c-649ac3c56d3d req-cb72d9a6-4c2f-4cbe-ae20-868d3e455abc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbec336a-d2a1-4417-ae64-bf09da7cceda", "tag": "e9da401c-2faa-4ed5-ba47-172b7b568c5a"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:19.561158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-e2637c0a-c677-4429-870c-649ac3c56d3d req-cb72d9a6-4c2f-4cbe-ae20-868d3e455abc service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:19.561158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-e2637c0a-c677-4429-870c-649ac3c56d3d req-cb72d9a6-4c2f-4cbe-ae20-868d3e455abc service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:19.605421 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-e2637c0a-c677-4429-870c-649ac3c56d3d req-cb72d9a6-4c2f-4cbe-ae20-868d3e455abc service nova] Creating event network-changed:e9da401c-2faa-4ed5-ba47-172b7b568c5a for instance cbec336a-d2a1-4417-ae64-bf09da7cceda on hv-cinder-83697 Jun 20 14:54:19.616440 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-e2637c0a-c677-4429-870c-649ac3c56d3d req-cb72d9a6-4c2f-4cbe-ae20-868d3e455abc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128711 Jun 20 14:54:19.618521 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-dc83dd46-db8a-4400-8ebc-13a23a730056 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:19.623865 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 144/291] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:19.632703 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-dc83dd46-db8a-4400-8ebc-13a23a730056 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.681759 Jun 20 14:54:19.636065 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 148/292] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:18 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:19.734627 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-04e77f25-dd25-45d8-8d80-3f3db6eb121f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:19.735588 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-04e77f25-dd25-45d8-8d80-3f3db6eb121f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:19.751259 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-04e77f25-dd25-45d8-8d80-3f3db6eb121f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:19.752077 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-04e77f25-dd25-45d8-8d80-3f3db6eb121f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:19.753532 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-04e77f25-dd25-45d8-8d80-3f3db6eb121f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:19.754287 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-04e77f25-dd25-45d8-8d80-3f3db6eb121f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:20.491650 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9787bc58-785b-4c6c-857e-a17e1881cf62 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:20.492401 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9787bc58-785b-4c6c-857e-a17e1881cf62 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:20.500660 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9787bc58-785b-4c6c-857e-a17e1881cf62 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:20.501150 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9787bc58-785b-4c6c-857e-a17e1881cf62 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:20.502014 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9787bc58-785b-4c6c-857e-a17e1881cf62 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:20.502510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9787bc58-785b-4c6c-857e-a17e1881cf62 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:20.793169 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9787bc58-785b-4c6c-857e-a17e1881cf62 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:20.801129 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9787bc58-785b-4c6c-857e-a17e1881cf62 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.313534 Jun 20 14:54:20.808974 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 149/293] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:20 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:54:20.814609 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-895240f8-8c99-49fb-8999-e476776f1c44 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:20.815218 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-895240f8-8c99-49fb-8999-e476776f1c44 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:20.839875 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-895240f8-8c99-49fb-8999-e476776f1c44 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:20.840326 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-895240f8-8c99-49fb-8999-e476776f1c44 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:20.841157 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-895240f8-8c99-49fb-8999-e476776f1c44 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:20.841589 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-895240f8-8c99-49fb-8999-e476776f1c44 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:21.006641 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-04e77f25-dd25-45d8-8d80-3f3db6eb121f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:21.017230 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-04e77f25-dd25-45d8-8d80-3f3db6eb121f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 1.287413 Jun 20 14:54:21.031519 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 145/294] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:19 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:21.213750 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-895240f8-8c99-49fb-8999-e476776f1c44 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:21.221962 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-895240f8-8c99-49fb-8999-e476776f1c44 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.411638 Jun 20 14:54:21.222821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 150/295] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:20 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:21.478676 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-04aefd86-a633-4e41-bb51-190e9930a86d req-4653e649-8182-4b39-94a3-525e6ead2187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68161747-6331-4819-a01b-24d3d5e80563", "tag": "ba17c8d3-ed5f-4cf2-8dbe-b795150fcdf8"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:21.498730 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-04aefd86-a633-4e41-bb51-190e9930a86d req-4653e649-8182-4b39-94a3-525e6ead2187 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:21.499090 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-04aefd86-a633-4e41-bb51-190e9930a86d req-4653e649-8182-4b39-94a3-525e6ead2187 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:21.559584 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-04aefd86-a633-4e41-bb51-190e9930a86d req-4653e649-8182-4b39-94a3-525e6ead2187 service nova] Creating event network-changed:ba17c8d3-ed5f-4cf2-8dbe-b795150fcdf8 for instance 68161747-6331-4819-a01b-24d3d5e80563 on hv-cinder-83697 Jun 20 14:54:21.577030 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-04aefd86-a633-4e41-bb51-190e9930a86d req-4653e649-8182-4b39-94a3-525e6ead2187 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102862 Jun 20 14:54:21.581742 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 146/296] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:21.825819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-374f67d2-9433-4b57-9ad6-7c3263e78d8e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:21.827284 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-374f67d2-9433-4b57-9ad6-7c3263e78d8e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:21.842564 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-374f67d2-9433-4b57-9ad6-7c3263e78d8e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:21.843319 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-374f67d2-9433-4b57-9ad6-7c3263e78d8e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:21.844527 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-374f67d2-9433-4b57-9ad6-7c3263e78d8e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:21.846859 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-374f67d2-9433-4b57-9ad6-7c3263e78d8e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:21.913021 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:22.039138 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-49d892b4-5458-4a91-9935-51b697d9102f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:22.040689 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-49d892b4-5458-4a91-9935-51b697d9102f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:22.059768 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-49d892b4-5458-4a91-9935-51b697d9102f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:22.062593 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-49d892b4-5458-4a91-9935-51b697d9102f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:22.064600 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-49d892b4-5458-4a91-9935-51b697d9102f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:22.066557 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-49d892b4-5458-4a91-9935-51b697d9102f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:22.197278 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-374f67d2-9433-4b57-9ad6-7c3263e78d8e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:22.210968 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-374f67d2-9433-4b57-9ad6-7c3263e78d8e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.389296 Jun 20 14:54:22.211550 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 151/297] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:21 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:22.238976 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b4ea50b9-0e61-43c1-b44c-837e12dc81a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:22.244518 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-b4ea50b9-0e61-43c1-b44c-837e12dc81a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:22.254051 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b4ea50b9-0e61-43c1-b44c-837e12dc81a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:22.254792 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b4ea50b9-0e61-43c1-b44c-837e12dc81a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:22.255746 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b4ea50b9-0e61-43c1-b44c-837e12dc81a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:22.256336 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b4ea50b9-0e61-43c1-b44c-837e12dc81a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:22.352818 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-49d892b4-5458-4a91-9935-51b697d9102f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:22.367014 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-49d892b4-5458-4a91-9935-51b697d9102f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.332738 Jun 20 14:54:22.367592 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 147/298] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:22 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:22.427055 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-b4ea50b9-0e61-43c1-b44c-837e12dc81a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:22.451241 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-b4ea50b9-0e61-43c1-b44c-837e12dc81a2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.216454 Jun 20 14:54:22.452454 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 152/299] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:22 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:54:23.231392 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e052328f-e310-4a38-aa04-e1a0129cf0ff tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:23.233439 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e052328f-e310-4a38-aa04-e1a0129cf0ff tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:23.245704 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e052328f-e310-4a38-aa04-e1a0129cf0ff tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:23.246350 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e052328f-e310-4a38-aa04-e1a0129cf0ff tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:23.247613 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e052328f-e310-4a38-aa04-e1a0129cf0ff tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:23.248381 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e052328f-e310-4a38-aa04-e1a0129cf0ff tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:23.292047 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:23.317504 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=12 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:23.384920 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-906b4ada-bdd6-4841-bfc3-b4f0ccc343a6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:23.385538 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-906b4ada-bdd6-4841-bfc3-b4f0ccc343a6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:23.387693 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=4 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:23.405230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-906b4ada-bdd6-4841-bfc3-b4f0ccc343a6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:23.406615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-906b4ada-bdd6-4841-bfc3-b4f0ccc343a6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:23.407619 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-906b4ada-bdd6-4841-bfc3-b4f0ccc343a6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:23.408492 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-906b4ada-bdd6-4841-bfc3-b4f0ccc343a6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:23.479951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=24 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:23.545641 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-e052328f-e310-4a38-aa04-e1a0129cf0ff tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:23.564815 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e052328f-e310-4a38-aa04-e1a0129cf0ff tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.339360 Jun 20 14:54:23.576796 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 148/300] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:23 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:23.589804 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-35591ccd-1c26-4f2b-8215-9a2fe74bc1f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:23.591236 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-35591ccd-1c26-4f2b-8215-9a2fe74bc1f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:23.594958 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-906b4ada-bdd6-4841-bfc3-b4f0ccc343a6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:23.604500 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-906b4ada-bdd6-4841-bfc3-b4f0ccc343a6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.224650 Jun 20 14:54:23.615361 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 153/301] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:23 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:23.626793 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-35591ccd-1c26-4f2b-8215-9a2fe74bc1f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:23.627909 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-35591ccd-1c26-4f2b-8215-9a2fe74bc1f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:23.629605 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-35591ccd-1c26-4f2b-8215-9a2fe74bc1f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:23.630456 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-35591ccd-1c26-4f2b-8215-9a2fe74bc1f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:23.860392 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-35591ccd-1c26-4f2b-8215-9a2fe74bc1f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:23.870280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-35591ccd-1c26-4f2b-8215-9a2fe74bc1f4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.291912 Jun 20 14:54:23.871370 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 149/302] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:23 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:24.583411 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3329d78d-22e5-4cb9-accb-f5e6abf0d85d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:24.584262 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3329d78d-22e5-4cb9-accb-f5e6abf0d85d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:24.603413 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3329d78d-22e5-4cb9-accb-f5e6abf0d85d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:24.603965 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3329d78d-22e5-4cb9-accb-f5e6abf0d85d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:24.604783 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3329d78d-22e5-4cb9-accb-f5e6abf0d85d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:24.605216 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3329d78d-22e5-4cb9-accb-f5e6abf0d85d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:24.622472 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-447b330d-c92b-441d-9ee6-7b1662f4c072 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:24.624830 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-447b330d-c92b-441d-9ee6-7b1662f4c072 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:24.646445 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-447b330d-c92b-441d-9ee6-7b1662f4c072 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:24.647183 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-447b330d-c92b-441d-9ee6-7b1662f4c072 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:24.648181 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-447b330d-c92b-441d-9ee6-7b1662f4c072 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:24.648787 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-447b330d-c92b-441d-9ee6-7b1662f4c072 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:24.803330 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3329d78d-22e5-4cb9-accb-f5e6abf0d85d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:24.812507 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3329d78d-22e5-4cb9-accb-f5e6abf0d85d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.232635 Jun 20 14:54:24.813677 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 154/303] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:24 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:24.868134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-447b330d-c92b-441d-9ee6-7b1662f4c072 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:24.877328 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-447b330d-c92b-441d-9ee6-7b1662f4c072 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.258902 Jun 20 14:54:24.890882 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 150/304] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:24 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:54:24.898947 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-fc1d150a-ccd9-4d8c-b329-610f16840975 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:24.900141 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-fc1d150a-ccd9-4d8c-b329-610f16840975 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:24.909645 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fc1d150a-ccd9-4d8c-b329-610f16840975 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:24.910313 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fc1d150a-ccd9-4d8c-b329-610f16840975 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:24.911292 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fc1d150a-ccd9-4d8c-b329-610f16840975 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:24.912032 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fc1d150a-ccd9-4d8c-b329-610f16840975 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:25.170067 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-fc1d150a-ccd9-4d8c-b329-610f16840975 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:25.179136 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-fc1d150a-ccd9-4d8c-b329-610f16840975 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.288255 Jun 20 14:54:25.179903 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 155/305] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:24 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:25.829973 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-943ed9a7-7454-49a3-9b8c-8b9791df15f5 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:25.831332 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-943ed9a7-7454-49a3-9b8c-8b9791df15f5 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:25.843276 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-943ed9a7-7454-49a3-9b8c-8b9791df15f5 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:25.844141 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-943ed9a7-7454-49a3-9b8c-8b9791df15f5 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:25.845265 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-943ed9a7-7454-49a3-9b8c-8b9791df15f5 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:25.849330 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-943ed9a7-7454-49a3-9b8c-8b9791df15f5 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:25.897079 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-f2709405-a4e3-45f5-87e4-6cb4b1197e6a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:25.898426 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-f2709405-a4e3-45f5-87e4-6cb4b1197e6a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:25.907856 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f2709405-a4e3-45f5-87e4-6cb4b1197e6a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:25.908306 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f2709405-a4e3-45f5-87e4-6cb4b1197e6a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:25.909135 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f2709405-a4e3-45f5-87e4-6cb4b1197e6a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:25.909562 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f2709405-a4e3-45f5-87e4-6cb4b1197e6a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:26.278790 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-f2709405-a4e3-45f5-87e4-6cb4b1197e6a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:26.295907 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-f2709405-a4e3-45f5-87e4-6cb4b1197e6a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.398698 Jun 20 14:54:26.299239 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 156/306] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:25 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:26.319320 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2eb90f7b-c0a7-4e6e-ab9b-7df4df54511e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:26.321812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-2eb90f7b-c0a7-4e6e-ab9b-7df4df54511e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:26.343031 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2eb90f7b-c0a7-4e6e-ab9b-7df4df54511e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:26.348483 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2eb90f7b-c0a7-4e6e-ab9b-7df4df54511e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:26.351498 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2eb90f7b-c0a7-4e6e-ab9b-7df4df54511e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:26.353089 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2eb90f7b-c0a7-4e6e-ab9b-7df4df54511e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:26.684739 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-2eb90f7b-c0a7-4e6e-ab9b-7df4df54511e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:26.698228 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-2eb90f7b-c0a7-4e6e-ab9b-7df4df54511e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.397400 Jun 20 14:54:26.699357 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 157/307] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:26 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:26.709724 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-943ed9a7-7454-49a3-9b8c-8b9791df15f5 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:26.718318 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-943ed9a7-7454-49a3-9b8c-8b9791df15f5 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.892231 Jun 20 14:54:26.719210 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 151/308] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:25 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:54:27.334458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-f98e9520-e70e-4ad2-bd32-cc29e6b4e579 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:27.336203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-f98e9520-e70e-4ad2-bd32-cc29e6b4e579 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:27.347633 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f98e9520-e70e-4ad2-bd32-cc29e6b4e579 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:27.348081 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f98e9520-e70e-4ad2-bd32-cc29e6b4e579 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:27.349738 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f98e9520-e70e-4ad2-bd32-cc29e6b4e579 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:27.350649 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f98e9520-e70e-4ad2-bd32-cc29e6b4e579 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:27.622313 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-f98e9520-e70e-4ad2-bd32-cc29e6b4e579 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:27.640992 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-f98e9520-e70e-4ad2-bd32-cc29e6b4e579 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.302115 Jun 20 14:54:27.645298 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 158/309] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:27 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:27.715700 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-bfece7c8-324f-483f-92ba-fa07169fd8b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:27.716413 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-bfece7c8-324f-483f-92ba-fa07169fd8b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:27.733501 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bfece7c8-324f-483f-92ba-fa07169fd8b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:27.734109 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bfece7c8-324f-483f-92ba-fa07169fd8b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:27.734899 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bfece7c8-324f-483f-92ba-fa07169fd8b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:27.735504 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bfece7c8-324f-483f-92ba-fa07169fd8b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:27.739791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-64fbfc89-128f-47ae-8fba-c4d8ac46927e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:27.740498 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-64fbfc89-128f-47ae-8fba-c4d8ac46927e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:27.753798 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-64fbfc89-128f-47ae-8fba-c4d8ac46927e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:27.754501 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-64fbfc89-128f-47ae-8fba-c4d8ac46927e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:27.756987 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-64fbfc89-128f-47ae-8fba-c4d8ac46927e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:27.764944 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-64fbfc89-128f-47ae-8fba-c4d8ac46927e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:28.085320 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-64fbfc89-128f-47ae-8fba-c4d8ac46927e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:28.103180 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-64fbfc89-128f-47ae-8fba-c4d8ac46927e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.367682 Jun 20 14:54:28.115614 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 159/310] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:27 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:54:28.231655 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-bfece7c8-324f-483f-92ba-fa07169fd8b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:28.241097 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-bfece7c8-324f-483f-92ba-fa07169fd8b7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.529768 Jun 20 14:54:28.241682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 152/311] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:27 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:28.649790 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3578ee8b-a176-4d5c-8f13-a3e500aef0f5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:28.652436 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3578ee8b-a176-4d5c-8f13-a3e500aef0f5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:28.676471 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3578ee8b-a176-4d5c-8f13-a3e500aef0f5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:28.678532 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3578ee8b-a176-4d5c-8f13-a3e500aef0f5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:28.683885 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3578ee8b-a176-4d5c-8f13-a3e500aef0f5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:28.684769 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3578ee8b-a176-4d5c-8f13-a3e500aef0f5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:29.078754 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3578ee8b-a176-4d5c-8f13-a3e500aef0f5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:29.091711 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3578ee8b-a176-4d5c-8f13-a3e500aef0f5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.446054 Jun 20 14:54:29.094230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 160/312] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:28 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:29.123261 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-411449df-9c08-4bbb-884d-4f10c867e5e8 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:29.125647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-411449df-9c08-4bbb-884d-4f10c867e5e8 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:29.139988 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-411449df-9c08-4bbb-884d-4f10c867e5e8 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:29.140854 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-411449df-9c08-4bbb-884d-4f10c867e5e8 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:29.141921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-411449df-9c08-4bbb-884d-4f10c867e5e8 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:29.142566 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-411449df-9c08-4bbb-884d-4f10c867e5e8 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:29.260113 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0bbe8387-b90c-4999-ba4d-3f6fa7bb6cda tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:29.260810 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-0bbe8387-b90c-4999-ba4d-3f6fa7bb6cda tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:29.297741 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0bbe8387-b90c-4999-ba4d-3f6fa7bb6cda tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:29.298216 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0bbe8387-b90c-4999-ba4d-3f6fa7bb6cda tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:29.298995 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0bbe8387-b90c-4999-ba4d-3f6fa7bb6cda tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:29.299430 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0bbe8387-b90c-4999-ba4d-3f6fa7bb6cda tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:29.519829 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-411449df-9c08-4bbb-884d-4f10c867e5e8 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:29.528388 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-411449df-9c08-4bbb-884d-4f10c867e5e8 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.409641 Jun 20 14:54:29.541176 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 153/313] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:29 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:29.581398 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0bbe8387-b90c-4999-ba4d-3f6fa7bb6cda tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:29.592387 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0bbe8387-b90c-4999-ba4d-3f6fa7bb6cda tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.336991 Jun 20 14:54:29.593462 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 161/314] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:29 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:30.112048 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-442ca6a4-8c8d-4180-a0f7-6d51242bfa19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:30.114856 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-442ca6a4-8c8d-4180-a0f7-6d51242bfa19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:30.122563 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-442ca6a4-8c8d-4180-a0f7-6d51242bfa19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:30.123808 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-442ca6a4-8c8d-4180-a0f7-6d51242bfa19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:30.126186 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-442ca6a4-8c8d-4180-a0f7-6d51242bfa19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:30.127058 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-442ca6a4-8c8d-4180-a0f7-6d51242bfa19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:30.415074 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-442ca6a4-8c8d-4180-a0f7-6d51242bfa19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:30.430087 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-442ca6a4-8c8d-4180-a0f7-6d51242bfa19 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.321195 Jun 20 14:54:30.445470 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 154/315] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:30 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:30.547755 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e322d083-4850-4b7b-956e-5ed20f1dd223 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:30.548364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e322d083-4850-4b7b-956e-5ed20f1dd223 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:30.566522 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e322d083-4850-4b7b-956e-5ed20f1dd223 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:30.569744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e322d083-4850-4b7b-956e-5ed20f1dd223 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:30.572642 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e322d083-4850-4b7b-956e-5ed20f1dd223 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:30.574005 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e322d083-4850-4b7b-956e-5ed20f1dd223 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:30.611333 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-5a88945c-9bb8-4e83-8340-4b8d5cb798dc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:30.611949 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-5a88945c-9bb8-4e83-8340-4b8d5cb798dc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:30.623677 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5a88945c-9bb8-4e83-8340-4b8d5cb798dc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:30.625392 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5a88945c-9bb8-4e83-8340-4b8d5cb798dc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:30.626750 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5a88945c-9bb8-4e83-8340-4b8d5cb798dc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:30.629728 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5a88945c-9bb8-4e83-8340-4b8d5cb798dc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:30.886567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e322d083-4850-4b7b-956e-5ed20f1dd223 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:30.898003 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e322d083-4850-4b7b-956e-5ed20f1dd223 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.354690 Jun 20 14:54:30.907830 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 162/316] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:30 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:30.980165 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-5a88945c-9bb8-4e83-8340-4b8d5cb798dc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:30.989773 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-5a88945c-9bb8-4e83-8340-4b8d5cb798dc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.382944 Jun 20 14:54:31.000941 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 155/317] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:30 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:31.455040 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-be717632-6c30-49a9-9d86-128122be9b4b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:31.455711 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-be717632-6c30-49a9-9d86-128122be9b4b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:31.463691 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-be717632-6c30-49a9-9d86-128122be9b4b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:31.465733 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-be717632-6c30-49a9-9d86-128122be9b4b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:31.465733 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-be717632-6c30-49a9-9d86-128122be9b4b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:31.465733 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-be717632-6c30-49a9-9d86-128122be9b4b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:31.676143 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-be717632-6c30-49a9-9d86-128122be9b4b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:31.683975 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-be717632-6c30-49a9-9d86-128122be9b4b tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.235405 Jun 20 14:54:31.685126 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 163/318] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:31 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:31.915745 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-32a3f1da-8431-459b-907f-68c0b7f1846c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:31.916418 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-32a3f1da-8431-459b-907f-68c0b7f1846c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:31.924235 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-32a3f1da-8431-459b-907f-68c0b7f1846c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:31.924605 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-32a3f1da-8431-459b-907f-68c0b7f1846c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:31.928276 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-32a3f1da-8431-459b-907f-68c0b7f1846c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:31.930474 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-32a3f1da-8431-459b-907f-68c0b7f1846c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:32.009259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-361dfddc-0026-4664-a296-423349b7f1c3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:32.009865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-361dfddc-0026-4664-a296-423349b7f1c3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:32.017961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-361dfddc-0026-4664-a296-423349b7f1c3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:32.018416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-361dfddc-0026-4664-a296-423349b7f1c3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:32.029407 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-361dfddc-0026-4664-a296-423349b7f1c3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:32.031626 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-361dfddc-0026-4664-a296-423349b7f1c3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:32.114043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-32a3f1da-8431-459b-907f-68c0b7f1846c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:32.126697 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-32a3f1da-8431-459b-907f-68c0b7f1846c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.214822 Jun 20 14:54:32.127990 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 156/319] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:31 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:32.271769 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-361dfddc-0026-4664-a296-423349b7f1c3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:32.281279 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-361dfddc-0026-4664-a296-423349b7f1c3 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.275952 Jun 20 14:54:32.281871 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 164/320] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:32 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:54:32.701696 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f81a8cb0-dead-413b-b3ce-af4a06a23a6c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:32.702395 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f81a8cb0-dead-413b-b3ce-af4a06a23a6c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:32.712408 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f81a8cb0-dead-413b-b3ce-af4a06a23a6c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:32.712924 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f81a8cb0-dead-413b-b3ce-af4a06a23a6c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:32.713708 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f81a8cb0-dead-413b-b3ce-af4a06a23a6c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:32.714230 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f81a8cb0-dead-413b-b3ce-af4a06a23a6c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:32.852204 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f81a8cb0-dead-413b-b3ce-af4a06a23a6c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:32.860374 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f81a8cb0-dead-413b-b3ce-af4a06a23a6c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.162565 Jun 20 14:54:32.860977 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 157/321] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:32 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:33.143365 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-fe9a9f01-3eb7-42ce-9ef7-f5b22f58666c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:33.144107 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-fe9a9f01-3eb7-42ce-9ef7-f5b22f58666c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:33.150776 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fe9a9f01-3eb7-42ce-9ef7-f5b22f58666c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:33.151228 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fe9a9f01-3eb7-42ce-9ef7-f5b22f58666c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:33.151989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fe9a9f01-3eb7-42ce-9ef7-f5b22f58666c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:33.152451 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fe9a9f01-3eb7-42ce-9ef7-f5b22f58666c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:33.286123 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-fe9a9f01-3eb7-42ce-9ef7-f5b22f58666c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:33.293884 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-fe9a9f01-3eb7-42ce-9ef7-f5b22f58666c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.154404 Jun 20 14:54:33.295737 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 165/322] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:33 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:33.301551 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6f9ea926-7dd0-4eaa-b6dd-bdd6c1344e12 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:33.302686 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6f9ea926-7dd0-4eaa-b6dd-bdd6c1344e12 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:33.311976 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6f9ea926-7dd0-4eaa-b6dd-bdd6c1344e12 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:33.312547 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6f9ea926-7dd0-4eaa-b6dd-bdd6c1344e12 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:33.313939 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6f9ea926-7dd0-4eaa-b6dd-bdd6c1344e12 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:33.314524 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6f9ea926-7dd0-4eaa-b6dd-bdd6c1344e12 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:33.446832 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-6f9ea926-7dd0-4eaa-b6dd-bdd6c1344e12 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:33.455177 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6f9ea926-7dd0-4eaa-b6dd-bdd6c1344e12 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.159958 Jun 20 14:54:33.455740 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 158/323] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:33 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:33.877876 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9859485b-3f1a-4c42-9add-a7b8382a60a2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:33.878482 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9859485b-3f1a-4c42-9add-a7b8382a60a2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:33.885150 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9859485b-3f1a-4c42-9add-a7b8382a60a2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:33.885597 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9859485b-3f1a-4c42-9add-a7b8382a60a2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:33.886354 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9859485b-3f1a-4c42-9add-a7b8382a60a2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:33.886783 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9859485b-3f1a-4c42-9add-a7b8382a60a2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:34.031872 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9859485b-3f1a-4c42-9add-a7b8382a60a2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:34.040168 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9859485b-3f1a-4c42-9add-a7b8382a60a2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.166364 Jun 20 14:54:34.040971 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 166/324] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:33 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:34.313669 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-a1b32746-fb41-47d3-81bd-66fd0986f83c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:34.314331 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-a1b32746-fb41-47d3-81bd-66fd0986f83c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:34.321294 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a1b32746-fb41-47d3-81bd-66fd0986f83c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:34.321738 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a1b32746-fb41-47d3-81bd-66fd0986f83c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:34.322561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a1b32746-fb41-47d3-81bd-66fd0986f83c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:34.322990 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a1b32746-fb41-47d3-81bd-66fd0986f83c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:34.454374 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-a1b32746-fb41-47d3-81bd-66fd0986f83c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:34.462806 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-a1b32746-fb41-47d3-81bd-66fd0986f83c tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.154158 Jun 20 14:54:34.463393 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 159/325] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:34 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:34.471592 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-fcbbaab6-23aa-459c-9c9b-2e7746404158 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:34.472191 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-fcbbaab6-23aa-459c-9c9b-2e7746404158 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:34.481798 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fcbbaab6-23aa-459c-9c9b-2e7746404158 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:34.482410 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fcbbaab6-23aa-459c-9c9b-2e7746404158 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:34.483352 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fcbbaab6-23aa-459c-9c9b-2e7746404158 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:34.483925 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fcbbaab6-23aa-459c-9c9b-2e7746404158 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:34.616947 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-fcbbaab6-23aa-459c-9c9b-2e7746404158 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:34.619153 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=100 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:34.625940 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-fcbbaab6-23aa-459c-9c9b-2e7746404158 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.158277 Jun 20 14:54:34.626484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 167/326] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:34 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:35.061286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-9eda0c27-2c86-46f2-a092-321a644a2de0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:35.062266 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-9eda0c27-2c86-46f2-a092-321a644a2de0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:35.071013 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9eda0c27-2c86-46f2-a092-321a644a2de0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:35.071634 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9eda0c27-2c86-46f2-a092-321a644a2de0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:35.072902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9eda0c27-2c86-46f2-a092-321a644a2de0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:35.073360 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9eda0c27-2c86-46f2-a092-321a644a2de0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:35.213892 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-9eda0c27-2c86-46f2-a092-321a644a2de0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:35.223223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-9eda0c27-2c86-46f2-a092-321a644a2de0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.168454 Jun 20 14:54:35.223834 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 160/327] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:35 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:35.479860 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-512693dd-6d3d-4324-8879-155b0c9e22ec tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:35.480437 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-512693dd-6d3d-4324-8879-155b0c9e22ec tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:35.487235 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-512693dd-6d3d-4324-8879-155b0c9e22ec tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:35.487668 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-512693dd-6d3d-4324-8879-155b0c9e22ec tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:35.488443 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-512693dd-6d3d-4324-8879-155b0c9e22ec tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:35.488904 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-512693dd-6d3d-4324-8879-155b0c9e22ec tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:35.619910 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-512693dd-6d3d-4324-8879-155b0c9e22ec tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:35.628181 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-512693dd-6d3d-4324-8879-155b0c9e22ec tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.152257 Jun 20 14:54:35.629013 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 168/328] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:35 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:35.642984 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0d23ce47-ae69-475d-95c4-5c2282db6ee8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:35.643542 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-0d23ce47-ae69-475d-95c4-5c2282db6ee8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:35.649993 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0d23ce47-ae69-475d-95c4-5c2282db6ee8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:35.650428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0d23ce47-ae69-475d-95c4-5c2282db6ee8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:35.651176 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0d23ce47-ae69-475d-95c4-5c2282db6ee8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:35.651596 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0d23ce47-ae69-475d-95c4-5c2282db6ee8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:35.666396 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=100 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:35.877795 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0d23ce47-ae69-475d-95c4-5c2282db6ee8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:35.886941 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0d23ce47-ae69-475d-95c4-5c2282db6ee8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.247763 Jun 20 14:54:35.887510 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 161/329] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:35 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:36.239914 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-4ce754a3-a1cc-461e-b641-665dfb57b3b1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:36.240528 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-4ce754a3-a1cc-461e-b641-665dfb57b3b1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:36.247036 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4ce754a3-a1cc-461e-b641-665dfb57b3b1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:36.247486 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4ce754a3-a1cc-461e-b641-665dfb57b3b1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:36.248265 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4ce754a3-a1cc-461e-b641-665dfb57b3b1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:36.248699 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4ce754a3-a1cc-461e-b641-665dfb57b3b1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:36.382945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-4ce754a3-a1cc-461e-b641-665dfb57b3b1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:36.390916 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-4ce754a3-a1cc-461e-b641-665dfb57b3b1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.155232 Jun 20 14:54:36.391402 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 169/330] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:36 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:36.645448 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-a8ee5974-6a32-4a47-9bfd-3a171cbf9c3f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:36.646080 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-a8ee5974-6a32-4a47-9bfd-3a171cbf9c3f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:36.653317 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a8ee5974-6a32-4a47-9bfd-3a171cbf9c3f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:36.653766 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a8ee5974-6a32-4a47-9bfd-3a171cbf9c3f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:36.654532 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a8ee5974-6a32-4a47-9bfd-3a171cbf9c3f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:36.654962 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a8ee5974-6a32-4a47-9bfd-3a171cbf9c3f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:36.793813 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-a8ee5974-6a32-4a47-9bfd-3a171cbf9c3f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:36.802245 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-a8ee5974-6a32-4a47-9bfd-3a171cbf9c3f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.161252 Jun 20 14:54:36.803392 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 162/331] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:36 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:36.904394 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7bd6eaa7-fc08-4364-9794-c5131003b55b tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:36.905138 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7bd6eaa7-fc08-4364-9794-c5131003b55b tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:36.912753 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7bd6eaa7-fc08-4364-9794-c5131003b55b tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:36.913206 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7bd6eaa7-fc08-4364-9794-c5131003b55b tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:36.914343 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7bd6eaa7-fc08-4364-9794-c5131003b55b tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:36.914923 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7bd6eaa7-fc08-4364-9794-c5131003b55b tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:37.078703 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7bd6eaa7-fc08-4364-9794-c5131003b55b tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:37.087648 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7bd6eaa7-fc08-4364-9794-c5131003b55b tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.187843 Jun 20 14:54:37.088355 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 170/332] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:36 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:37.408967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-30e78425-0d63-47f6-98ae-90d85865a02d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:37.409726 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-30e78425-0d63-47f6-98ae-90d85865a02d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:37.416808 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-30e78425-0d63-47f6-98ae-90d85865a02d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:37.417337 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-30e78425-0d63-47f6-98ae-90d85865a02d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:37.418475 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-30e78425-0d63-47f6-98ae-90d85865a02d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:37.418898 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-30e78425-0d63-47f6-98ae-90d85865a02d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:37.573562 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-30e78425-0d63-47f6-98ae-90d85865a02d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:37.581343 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-30e78425-0d63-47f6-98ae-90d85865a02d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.176558 Jun 20 14:54:37.581903 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 163/333] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:37 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:37.822020 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-bece895c-281f-49aa-9ae9-ee5261298bb7 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:37.822638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-bece895c-281f-49aa-9ae9-ee5261298bb7 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:37.824669 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:37.830254 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bece895c-281f-49aa-9ae9-ee5261298bb7 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:37.830692 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bece895c-281f-49aa-9ae9-ee5261298bb7 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:37.831450 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bece895c-281f-49aa-9ae9-ee5261298bb7 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:37.831880 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bece895c-281f-49aa-9ae9-ee5261298bb7 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:37.965148 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-bece895c-281f-49aa-9ae9-ee5261298bb7 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:37.972779 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-bece895c-281f-49aa-9ae9-ee5261298bb7 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.155102 Jun 20 14:54:37.973350 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 171/334] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:37 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:38.104272 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2bbc33fb-3681-47eb-953d-4660de03567f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:38.104911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2bbc33fb-3681-47eb-953d-4660de03567f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:38.112336 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2bbc33fb-3681-47eb-953d-4660de03567f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:38.112854 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2bbc33fb-3681-47eb-953d-4660de03567f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:38.113944 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2bbc33fb-3681-47eb-953d-4660de03567f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:38.114385 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2bbc33fb-3681-47eb-953d-4660de03567f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:38.256164 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2bbc33fb-3681-47eb-953d-4660de03567f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:38.263977 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2bbc33fb-3681-47eb-953d-4660de03567f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.163575 Jun 20 14:54:38.264638 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 164/335] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:38 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:38.598550 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-712cf6b1-85ce-46af-8000-a05351663dd3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:38.599212 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-712cf6b1-85ce-46af-8000-a05351663dd3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:38.605777 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-712cf6b1-85ce-46af-8000-a05351663dd3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:38.606291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-712cf6b1-85ce-46af-8000-a05351663dd3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:38.607118 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-712cf6b1-85ce-46af-8000-a05351663dd3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:38.609523 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-712cf6b1-85ce-46af-8000-a05351663dd3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:38.743906 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-712cf6b1-85ce-46af-8000-a05351663dd3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:38.753129 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-712cf6b1-85ce-46af-8000-a05351663dd3 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.158543 Jun 20 14:54:38.753889 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 172/336] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:38 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:38.993158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-65244675-9c38-44ae-91db-ea11a840f9c4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:38.993775 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-65244675-9c38-44ae-91db-ea11a840f9c4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:39.000668 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-65244675-9c38-44ae-91db-ea11a840f9c4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:39.001147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-65244675-9c38-44ae-91db-ea11a840f9c4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:39.001901 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-65244675-9c38-44ae-91db-ea11a840f9c4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:39.002330 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-65244675-9c38-44ae-91db-ea11a840f9c4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:39.146351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-65244675-9c38-44ae-91db-ea11a840f9c4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:39.153951 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-65244675-9c38-44ae-91db-ea11a840f9c4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.166633 Jun 20 14:54:39.154662 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 165/337] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:38 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:39.281035 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8176bb06-6b7f-4db1-83d3-c5a73536c24a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:39.281644 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-8176bb06-6b7f-4db1-83d3-c5a73536c24a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:39.288877 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8176bb06-6b7f-4db1-83d3-c5a73536c24a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:39.289309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8176bb06-6b7f-4db1-83d3-c5a73536c24a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:39.290072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8176bb06-6b7f-4db1-83d3-c5a73536c24a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:39.290502 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8176bb06-6b7f-4db1-83d3-c5a73536c24a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:39.430021 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8176bb06-6b7f-4db1-83d3-c5a73536c24a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:39.438103 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-8176bb06-6b7f-4db1-83d3-c5a73536c24a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.160688 Jun 20 14:54:39.438676 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 173/338] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:39 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:39.774577 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b2668260-ad26-4887-b493-7a5414d96cce tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:39.775249 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-b2668260-ad26-4887-b493-7a5414d96cce tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:39.782365 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b2668260-ad26-4887-b493-7a5414d96cce tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:39.782858 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b2668260-ad26-4887-b493-7a5414d96cce tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:39.783677 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b2668260-ad26-4887-b493-7a5414d96cce tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:39.784173 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b2668260-ad26-4887-b493-7a5414d96cce tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:39.919564 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-b2668260-ad26-4887-b493-7a5414d96cce tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:39.931314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b2668260-ad26-4887-b493-7a5414d96cce tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.163241 Jun 20 14:54:39.932236 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 166/339] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:39 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:40.170680 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-c49df1a6-670c-45fb-a774-28e1b7a29b6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:40.171276 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-c49df1a6-670c-45fb-a774-28e1b7a29b6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:40.177644 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c49df1a6-670c-45fb-a774-28e1b7a29b6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:40.178083 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c49df1a6-670c-45fb-a774-28e1b7a29b6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:40.178831 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c49df1a6-670c-45fb-a774-28e1b7a29b6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:40.179253 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c49df1a6-670c-45fb-a774-28e1b7a29b6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:40.316043 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-c49df1a6-670c-45fb-a774-28e1b7a29b6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:40.327394 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-c49df1a6-670c-45fb-a774-28e1b7a29b6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.160115 Jun 20 14:54:40.330826 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 174/340] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:40 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:40.460074 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-94be583d-1762-4c1c-a8ca-dff72df32850 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:40.460630 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-94be583d-1762-4c1c-a8ca-dff72df32850 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:40.467567 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-94be583d-1762-4c1c-a8ca-dff72df32850 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:40.468001 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-94be583d-1762-4c1c-a8ca-dff72df32850 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:40.468756 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-94be583d-1762-4c1c-a8ca-dff72df32850 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:40.469211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-94be583d-1762-4c1c-a8ca-dff72df32850 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:40.610518 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-94be583d-1762-4c1c-a8ca-dff72df32850 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:40.620121 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-94be583d-1762-4c1c-a8ca-dff72df32850 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.167084 Jun 20 14:54:40.620694 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 167/341] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:40 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:40.957248 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-45294856-7e79-46d1-bc61-aac6e1428214 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:40.958238 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-45294856-7e79-46d1-bc61-aac6e1428214 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:40.965176 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-45294856-7e79-46d1-bc61-aac6e1428214 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:40.965612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-45294856-7e79-46d1-bc61-aac6e1428214 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:40.966366 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-45294856-7e79-46d1-bc61-aac6e1428214 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:40.966788 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-45294856-7e79-46d1-bc61-aac6e1428214 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:41.109131 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-45294856-7e79-46d1-bc61-aac6e1428214 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:41.117018 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-45294856-7e79-46d1-bc61-aac6e1428214 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.166236 Jun 20 14:54:41.117580 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 175/342] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:40 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:41.349664 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-15c7aa54-dcaa-4990-9010-0d041cb35414 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:41.350400 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-15c7aa54-dcaa-4990-9010-0d041cb35414 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:41.357463 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-15c7aa54-dcaa-4990-9010-0d041cb35414 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:41.357831 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-15c7aa54-dcaa-4990-9010-0d041cb35414 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:41.358589 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-15c7aa54-dcaa-4990-9010-0d041cb35414 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:41.359011 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-15c7aa54-dcaa-4990-9010-0d041cb35414 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:41.486755 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-15c7aa54-dcaa-4990-9010-0d041cb35414 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:41.494384 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-15c7aa54-dcaa-4990-9010-0d041cb35414 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.151596 Jun 20 14:54:41.494957 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 168/343] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:41 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:41.640235 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3bfd7be7-c431-4edd-9140-22a34fc9a0c5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:41.641023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3bfd7be7-c431-4edd-9140-22a34fc9a0c5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:41.650402 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3bfd7be7-c431-4edd-9140-22a34fc9a0c5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:41.651008 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3bfd7be7-c431-4edd-9140-22a34fc9a0c5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:41.652024 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3bfd7be7-c431-4edd-9140-22a34fc9a0c5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:41.652610 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3bfd7be7-c431-4edd-9140-22a34fc9a0c5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:41.805165 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3bfd7be7-c431-4edd-9140-22a34fc9a0c5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:41.813941 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3bfd7be7-c431-4edd-9140-22a34fc9a0c5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.179211 Jun 20 14:54:41.814605 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 176/344] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:41 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:42.122359 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-d9318ae6-a4f4-488f-ab10-90b577e6dd22 req-ce267abf-af70-4870-90d4-6e46326fdd5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e28018-9057-44e5-a730-871114cf6249", "name": "network-vif-plugged", "status": "completed", "tag": "6ee3c9d3-8185-4e24-b29a-20f7ceb97549"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:42.131566 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-d9318ae6-a4f4-488f-ab10-90b577e6dd22 req-ce267abf-af70-4870-90d4-6e46326fdd5e service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:42.132254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-d9318ae6-a4f4-488f-ab10-90b577e6dd22 req-ce267abf-af70-4870-90d4-6e46326fdd5e service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:42.134132 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-4ba9fe8d-e81e-4afd-8eff-a8e0715b403c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:42.134765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-4ba9fe8d-e81e-4afd-8eff-a8e0715b403c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:42.142269 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4ba9fe8d-e81e-4afd-8eff-a8e0715b403c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:42.142816 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4ba9fe8d-e81e-4afd-8eff-a8e0715b403c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:42.143583 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4ba9fe8d-e81e-4afd-8eff-a8e0715b403c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:42.144108 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4ba9fe8d-e81e-4afd-8eff-a8e0715b403c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:42.145753 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-d9318ae6-a4f4-488f-ab10-90b577e6dd22 req-ce267abf-af70-4870-90d4-6e46326fdd5e service nova] Creating event network-vif-plugged:6ee3c9d3-8185-4e24-b29a-20f7ceb97549 for instance 33e28018-9057-44e5-a730-871114cf6249 on hv-cinder-83697 Jun 20 14:54:42.152136 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-d9318ae6-a4f4-488f-ab10-90b577e6dd22 req-ce267abf-af70-4870-90d4-6e46326fdd5e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033235 Jun 20 14:54:42.153179 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 169/345] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:42.322024 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-4ba9fe8d-e81e-4afd-8eff-a8e0715b403c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:42.330109 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-4ba9fe8d-e81e-4afd-8eff-a8e0715b403c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.199942 Jun 20 14:54:42.330705 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 177/346] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:42 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:42.512588 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7b00ea1c-ed86-45bc-8898-abfa175106b6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:42.513386 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7b00ea1c-ed86-45bc-8898-abfa175106b6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:42.515477 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:42.521141 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7b00ea1c-ed86-45bc-8898-abfa175106b6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:42.521425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7b00ea1c-ed86-45bc-8898-abfa175106b6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:42.522187 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7b00ea1c-ed86-45bc-8898-abfa175106b6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:42.522610 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7b00ea1c-ed86-45bc-8898-abfa175106b6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:42.656528 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-7b00ea1c-ed86-45bc-8898-abfa175106b6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:42.664611 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7b00ea1c-ed86-45bc-8898-abfa175106b6 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.156760 Jun 20 14:54:42.665211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 170/347] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:42 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:42.831935 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-fdf71224-d2c0-4c87-86dd-459447ab34b6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:42.832583 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-fdf71224-d2c0-4c87-86dd-459447ab34b6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:42.839729 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fdf71224-d2c0-4c87-86dd-459447ab34b6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:42.840183 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fdf71224-d2c0-4c87-86dd-459447ab34b6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:42.841007 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fdf71224-d2c0-4c87-86dd-459447ab34b6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:42.841452 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fdf71224-d2c0-4c87-86dd-459447ab34b6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:42.979305 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-fdf71224-d2c0-4c87-86dd-459447ab34b6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:42.987031 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-fdf71224-d2c0-4c87-86dd-459447ab34b6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.159276 Jun 20 14:54:42.987611 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 178/348] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:42 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:43.347483 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-bf979256-0d9c-4096-a24f-fda920f9b718 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:43.348157 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-bf979256-0d9c-4096-a24f-fda920f9b718 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:43.355591 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bf979256-0d9c-4096-a24f-fda920f9b718 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:43.356063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bf979256-0d9c-4096-a24f-fda920f9b718 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:43.356893 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bf979256-0d9c-4096-a24f-fda920f9b718 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:43.357327 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bf979256-0d9c-4096-a24f-fda920f9b718 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:43.501189 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-bf979256-0d9c-4096-a24f-fda920f9b718 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:43.508980 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-bf979256-0d9c-4096-a24f-fda920f9b718 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.165708 Jun 20 14:54:43.509528 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 171/349] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:43 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:43.682268 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-bb0497d8-9ae0-40f0-86a9-eee9eab6a87b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:43.682887 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-bb0497d8-9ae0-40f0-86a9-eee9eab6a87b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:43.690423 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bb0497d8-9ae0-40f0-86a9-eee9eab6a87b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:43.690881 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bb0497d8-9ae0-40f0-86a9-eee9eab6a87b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:43.691640 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bb0497d8-9ae0-40f0-86a9-eee9eab6a87b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:43.692084 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bb0497d8-9ae0-40f0-86a9-eee9eab6a87b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:43.826881 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-bb0497d8-9ae0-40f0-86a9-eee9eab6a87b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:43.834686 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-bb0497d8-9ae0-40f0-86a9-eee9eab6a87b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.156370 Jun 20 14:54:43.835259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 179/350] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:43 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:44.004883 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7e4cfac3-a589-4804-b295-f1b3cdfccaf9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:44.005723 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7e4cfac3-a589-4804-b295-f1b3cdfccaf9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:44.012623 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7e4cfac3-a589-4804-b295-f1b3cdfccaf9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:44.013115 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7e4cfac3-a589-4804-b295-f1b3cdfccaf9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:44.013896 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7e4cfac3-a589-4804-b295-f1b3cdfccaf9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:44.014331 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7e4cfac3-a589-4804-b295-f1b3cdfccaf9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:44.148907 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-7e4cfac3-a589-4804-b295-f1b3cdfccaf9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:44.157783 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7e4cfac3-a589-4804-b295-f1b3cdfccaf9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.156445 Jun 20 14:54:44.158107 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 172/351] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:43 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:44.167312 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-f8e8036d-e4c1-4582-bf67-5cd82ec4717d req-991d8282-d350-4fcc-bd79-5118f1a7a45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbec336a-d2a1-4417-ae64-bf09da7cceda", "name": "network-vif-plugged", "status": "completed", "tag": "e9da401c-2faa-4ed5-ba47-172b7b568c5a"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:44.179747 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-f8e8036d-e4c1-4582-bf67-5cd82ec4717d req-991d8282-d350-4fcc-bd79-5118f1a7a45d service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:44.180181 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-f8e8036d-e4c1-4582-bf67-5cd82ec4717d req-991d8282-d350-4fcc-bd79-5118f1a7a45d service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:44.193186 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-f8e8036d-e4c1-4582-bf67-5cd82ec4717d req-991d8282-d350-4fcc-bd79-5118f1a7a45d service nova] Creating event network-vif-plugged:e9da401c-2faa-4ed5-ba47-172b7b568c5a for instance cbec336a-d2a1-4417-ae64-bf09da7cceda on hv-cinder-83697 Jun 20 14:54:44.198230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-f8e8036d-e4c1-4582-bf67-5cd82ec4717d req-991d8282-d350-4fcc-bd79-5118f1a7a45d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034863 Jun 20 14:54:44.198764 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 180/352] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:44.526931 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e2115f91-783a-4c42-a317-73abbbad2d89 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:44.527559 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e2115f91-783a-4c42-a317-73abbbad2d89 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:44.534072 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e2115f91-783a-4c42-a317-73abbbad2d89 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:44.534517 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e2115f91-783a-4c42-a317-73abbbad2d89 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:44.535283 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e2115f91-783a-4c42-a317-73abbbad2d89 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:44.535707 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e2115f91-783a-4c42-a317-73abbbad2d89 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:44.667502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-e2115f91-783a-4c42-a317-73abbbad2d89 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:44.675235 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e2115f91-783a-4c42-a317-73abbbad2d89 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.152336 Jun 20 14:54:44.675808 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 173/353] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:44 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:44.855286 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3faa9e09-d2cb-4d82-9353-074f2558a3de tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:44.856103 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3faa9e09-d2cb-4d82-9353-074f2558a3de tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:44.865664 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3faa9e09-d2cb-4d82-9353-074f2558a3de tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:44.866115 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3faa9e09-d2cb-4d82-9353-074f2558a3de tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:44.866877 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3faa9e09-d2cb-4d82-9353-074f2558a3de tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:44.867306 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3faa9e09-d2cb-4d82-9353-074f2558a3de tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:45.010164 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3faa9e09-d2cb-4d82-9353-074f2558a3de tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:45.020177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3faa9e09-d2cb-4d82-9353-074f2558a3de tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.171568 Jun 20 14:54:45.020864 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 181/354] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:44 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:45.175002 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ffa7338a-7257-4b83-b7a5-e1156ddb9f2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:45.175608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ffa7338a-7257-4b83-b7a5-e1156ddb9f2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:45.183082 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ffa7338a-7257-4b83-b7a5-e1156ddb9f2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:45.183843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ffa7338a-7257-4b83-b7a5-e1156ddb9f2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:45.185115 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ffa7338a-7257-4b83-b7a5-e1156ddb9f2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:45.185751 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ffa7338a-7257-4b83-b7a5-e1156ddb9f2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:45.357584 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ffa7338a-7257-4b83-b7a5-e1156ddb9f2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:45.365450 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ffa7338a-7257-4b83-b7a5-e1156ddb9f2a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.194475 Jun 20 14:54:45.366026 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 174/355] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:45 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:45.696221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-deeb2cf7-9e54-4280-aae5-028ddd73e6be tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:45.696931 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-deeb2cf7-9e54-4280-aae5-028ddd73e6be tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:45.707262 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-deeb2cf7-9e54-4280-aae5-028ddd73e6be tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:45.707879 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-deeb2cf7-9e54-4280-aae5-028ddd73e6be tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:45.709055 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-deeb2cf7-9e54-4280-aae5-028ddd73e6be tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:45.709488 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-deeb2cf7-9e54-4280-aae5-028ddd73e6be tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:45.852640 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-deeb2cf7-9e54-4280-aae5-028ddd73e6be tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:45.860410 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-deeb2cf7-9e54-4280-aae5-028ddd73e6be tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.170607 Jun 20 14:54:45.861025 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 182/356] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:45 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:46.039672 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-44e61fab-a423-41e0-8c43-8776395484d4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:46.040458 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-44e61fab-a423-41e0-8c43-8776395484d4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:46.047128 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-44e61fab-a423-41e0-8c43-8776395484d4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:46.047567 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-44e61fab-a423-41e0-8c43-8776395484d4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:46.048325 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-44e61fab-a423-41e0-8c43-8776395484d4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:46.048750 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-44e61fab-a423-41e0-8c43-8776395484d4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:46.182061 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-44e61fab-a423-41e0-8c43-8776395484d4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:46.190573 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-44e61fab-a423-41e0-8c43-8776395484d4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1359 microversion: 2.1 time: 0.156222 Jun 20 14:54:46.191157 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 175/357] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:46 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:46.384570 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-cc1cef4e-6752-488a-a36e-d843ec848aa6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:46.385283 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-cc1cef4e-6752-488a-a36e-d843ec848aa6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:46.394366 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cc1cef4e-6752-488a-a36e-d843ec848aa6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:46.394818 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cc1cef4e-6752-488a-a36e-d843ec848aa6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:46.395564 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cc1cef4e-6752-488a-a36e-d843ec848aa6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:46.396118 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cc1cef4e-6752-488a-a36e-d843ec848aa6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:46.532795 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-cc1cef4e-6752-488a-a36e-d843ec848aa6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:46.543527 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-cc1cef4e-6752-488a-a36e-d843ec848aa6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.164595 Jun 20 14:54:46.544280 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 183/358] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:46 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:46.881020 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-5c1e3f60-7ace-410d-9dd8-71d11934d158 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:46.881782 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-5c1e3f60-7ace-410d-9dd8-71d11934d158 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:46.888314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5c1e3f60-7ace-410d-9dd8-71d11934d158 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:46.888770 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5c1e3f60-7ace-410d-9dd8-71d11934d158 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:46.889561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5c1e3f60-7ace-410d-9dd8-71d11934d158 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:46.889991 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5c1e3f60-7ace-410d-9dd8-71d11934d158 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:47.026303 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-5c1e3f60-7ace-410d-9dd8-71d11934d158 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:47.033922 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-5c1e3f60-7ace-410d-9dd8-71d11934d158 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.159035 Jun 20 14:54:47.034499 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 176/359] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:46 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:47.211398 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-a50fc619-3add-4a40-bfc7-17451206006b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:47.212914 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-a50fc619-3add-4a40-bfc7-17451206006b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:47.221212 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a50fc619-3add-4a40-bfc7-17451206006b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:47.221735 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a50fc619-3add-4a40-bfc7-17451206006b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:47.222658 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a50fc619-3add-4a40-bfc7-17451206006b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:47.223164 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a50fc619-3add-4a40-bfc7-17451206006b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:47.564339 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e9e1e2bd-aeae-4a5d-889f-6be38c3eb7d7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:47.565067 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e9e1e2bd-aeae-4a5d-889f-6be38c3eb7d7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:47.565993 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a50fc619-3add-4a40-bfc7-17451206006b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:47.571960 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e9e1e2bd-aeae-4a5d-889f-6be38c3eb7d7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:47.572508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e9e1e2bd-aeae-4a5d-889f-6be38c3eb7d7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:47.573361 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e9e1e2bd-aeae-4a5d-889f-6be38c3eb7d7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:47.573884 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e9e1e2bd-aeae-4a5d-889f-6be38c3eb7d7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:47.574626 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-a50fc619-3add-4a40-bfc7-17451206006b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1550 microversion: 2.1 time: 0.369021 Jun 20 14:54:47.575202 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 184/360] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:47 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1550 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:47.592692 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-407ec8ea-83c2-493a-9d5d-7d413476e224 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:47.593446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-407ec8ea-83c2-493a-9d5d-7d413476e224 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:47.599647 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-407ec8ea-83c2-493a-9d5d-7d413476e224 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:47.600431 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-407ec8ea-83c2-493a-9d5d-7d413476e224 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:47.600894 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-407ec8ea-83c2-493a-9d5d-7d413476e224 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:47.601343 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-407ec8ea-83c2-493a-9d5d-7d413476e224 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:47.604059 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=100 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:47.705878 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-e9e1e2bd-aeae-4a5d-889f-6be38c3eb7d7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:47.714142 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e9e1e2bd-aeae-4a5d-889f-6be38c3eb7d7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.154424 Jun 20 14:54:47.714840 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 177/361] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:47 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:47.728976 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-407ec8ea-83c2-493a-9d5d-7d413476e224 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:47.736325 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-407ec8ea-83c2-493a-9d5d-7d413476e224 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1550 microversion: 2.1 time: 0.147520 Jun 20 14:54:47.736912 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 185/362] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:47 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:54:47.752900 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-af9c3fea-b96b-4396-ba3c-667ec0813b46 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:47.756475 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-af9c3fea-b96b-4396-ba3c-667ec0813b46 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:47.757425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-af9c3fea-b96b-4396-ba3c-667ec0813b46 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Searching by: {'deleted': False, 'project_id': '7500725f7c744f318862323e13c5f23e'} {{(pid=123978) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 14:54:47.764214 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-af9c3fea-b96b-4396-ba3c-667ec0813b46 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:47.764660 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-af9c3fea-b96b-4396-ba3c-667ec0813b46 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:47.765490 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-af9c3fea-b96b-4396-ba3c-667ec0813b46 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:47.765922 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-af9c3fea-b96b-4396-ba3c-667ec0813b46 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:47.858475 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.multi_cell_list [None req-af9c3fea-b96b-4396-ba3c-667ec0813b46 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123978) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 14:54:47.883696 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=100 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:47.914221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-2ea0fa04-48c3-4752-b475-19de1ea3f8ab req-d9f487c1-74a7-4d5f-b97e-b8236c62397d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68161747-6331-4819-a01b-24d3d5e80563", "name": "network-vif-plugged", "status": "completed", "tag": "ba17c8d3-ed5f-4cf2-8dbe-b795150fcdf8"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:47.922786 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-2ea0fa04-48c3-4752-b475-19de1ea3f8ab req-d9f487c1-74a7-4d5f-b97e-b8236c62397d service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:47.923219 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-2ea0fa04-48c3-4752-b475-19de1ea3f8ab req-d9f487c1-74a7-4d5f-b97e-b8236c62397d service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:47.934948 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-2ea0fa04-48c3-4752-b475-19de1ea3f8ab req-d9f487c1-74a7-4d5f-b97e-b8236c62397d service nova] Creating event network-vif-plugged:ba17c8d3-ed5f-4cf2-8dbe-b795150fcdf8 for instance 68161747-6331-4819-a01b-24d3d5e80563 on hv-cinder-83697 Jun 20 14:54:47.940223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-2ea0fa04-48c3-4752-b475-19de1ea3f8ab req-d9f487c1-74a7-4d5f-b97e-b8236c62397d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029708 Jun 20 14:54:47.940834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 186/363] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:47.953196 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-af9c3fea-b96b-4396-ba3c-667ec0813b46 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204420 Jun 20 14:54:47.954524 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 178/364] 10.222.0.23 () {58 vars in 1124 bytes} [Mon Jun 20 14:54:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:47.966039 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-f1da6aea-ac28-4daa-b78e-787cd58bb01f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:47.966724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-f1da6aea-ac28-4daa-b78e-787cd58bb01f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:47.975035 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f1da6aea-ac28-4daa-b78e-787cd58bb01f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:47.975604 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f1da6aea-ac28-4daa-b78e-787cd58bb01f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:47.976376 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f1da6aea-ac28-4daa-b78e-787cd58bb01f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:47.976841 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f1da6aea-ac28-4daa-b78e-787cd58bb01f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:48.051189 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-50f65712-58e4-4712-a0a9-a191ba3cb8b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:48.051898 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-50f65712-58e4-4712-a0a9-a191ba3cb8b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:48.058671 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-50f65712-58e4-4712-a0a9-a191ba3cb8b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:48.059191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-50f65712-58e4-4712-a0a9-a191ba3cb8b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:48.060075 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-50f65712-58e4-4712-a0a9-a191ba3cb8b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:48.060571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-50f65712-58e4-4712-a0a9-a191ba3cb8b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:48.107345 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-f1da6aea-ac28-4daa-b78e-787cd58bb01f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:48.115112 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-f1da6aea-ac28-4daa-b78e-787cd58bb01f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1550 microversion: 2.1 time: 0.153172 Jun 20 14:54:48.115638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 187/365] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:47 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:48.196095 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-50f65712-58e4-4712-a0a9-a191ba3cb8b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:48.204758 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-50f65712-58e4-4712-a0a9-a191ba3cb8b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.157574 Jun 20 14:54:48.205335 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 179/366] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:48 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:48.735162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d86bf4c4-b08c-46c3-9be7-bef7197943ca tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:48.736087 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d86bf4c4-b08c-46c3-9be7-bef7197943ca tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:48.744797 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d86bf4c4-b08c-46c3-9be7-bef7197943ca tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:48.745212 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d86bf4c4-b08c-46c3-9be7-bef7197943ca tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:48.745982 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d86bf4c4-b08c-46c3-9be7-bef7197943ca tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:48.746416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d86bf4c4-b08c-46c3-9be7-bef7197943ca tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:48.875498 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d86bf4c4-b08c-46c3-9be7-bef7197943ca tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:48.884392 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d86bf4c4-b08c-46c3-9be7-bef7197943ca tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.155676 Jun 20 14:54:48.884970 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 188/367] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:48 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:49.225701 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-5b651dbf-a062-46c1-bfff-f09174b55c74 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:49.226641 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-5b651dbf-a062-46c1-bfff-f09174b55c74 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:49.237692 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5b651dbf-a062-46c1-bfff-f09174b55c74 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:49.238424 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5b651dbf-a062-46c1-bfff-f09174b55c74 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:49.239681 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5b651dbf-a062-46c1-bfff-f09174b55c74 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:49.240405 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5b651dbf-a062-46c1-bfff-f09174b55c74 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:49.380040 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-5b651dbf-a062-46c1-bfff-f09174b55c74 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:49.390844 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-5b651dbf-a062-46c1-bfff-f09174b55c74 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1367 microversion: 2.1 time: 0.171616 Jun 20 14:54:49.391380 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 180/368] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:49 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:49.903813 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6f73a48f-924d-4e8f-aac1-777ed9f96b1e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:49.904546 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-6f73a48f-924d-4e8f-aac1-777ed9f96b1e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:49.911499 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6f73a48f-924d-4e8f-aac1-777ed9f96b1e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:49.912048 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6f73a48f-924d-4e8f-aac1-777ed9f96b1e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:49.912834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6f73a48f-924d-4e8f-aac1-777ed9f96b1e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:49.913263 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6f73a48f-924d-4e8f-aac1-777ed9f96b1e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:50.049482 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6f73a48f-924d-4e8f-aac1-777ed9f96b1e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:50.057722 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6f73a48f-924d-4e8f-aac1-777ed9f96b1e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.159573 Jun 20 14:54:50.058302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 189/369] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:49 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:50.411790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-82dedf8a-4dd1-40b7-9be1-850d7f9e4328 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:50.412607 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-82dedf8a-4dd1-40b7-9be1-850d7f9e4328 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:50.419573 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-82dedf8a-4dd1-40b7-9be1-850d7f9e4328 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:50.420014 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-82dedf8a-4dd1-40b7-9be1-850d7f9e4328 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:50.420876 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-82dedf8a-4dd1-40b7-9be1-850d7f9e4328 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:50.421202 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-82dedf8a-4dd1-40b7-9be1-850d7f9e4328 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:50.561895 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-82dedf8a-4dd1-40b7-9be1-850d7f9e4328 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:50.575551 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-82dedf8a-4dd1-40b7-9be1-850d7f9e4328 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1557 microversion: 2.1 time: 0.170177 Jun 20 14:54:50.576202 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 181/370] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:50 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:50.592459 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-aa305f98-0b8d-41dc-b848-25baf8271c75 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:50.593102 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-aa305f98-0b8d-41dc-b848-25baf8271c75 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:50.599799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-aa305f98-0b8d-41dc-b848-25baf8271c75 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:50.600310 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-aa305f98-0b8d-41dc-b848-25baf8271c75 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:50.601207 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-aa305f98-0b8d-41dc-b848-25baf8271c75 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:50.601705 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-aa305f98-0b8d-41dc-b848-25baf8271c75 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:50.694267 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-aa305f98-0b8d-41dc-b848-25baf8271c75 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106134 Jun 20 14:54:50.694962 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 190/371] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 14:54:50 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:50.707264 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-eec86809-ffdf-4766-b9f2-238e7912a331 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f789ab21-1f36-46a0-8ccd-88160bf1d57b"}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:50.714318 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-eec86809-ffdf-4766-b9f2-238e7912a331 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:50.720868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eec86809-ffdf-4766-b9f2-238e7912a331 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:50.721662 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eec86809-ffdf-4766-b9f2-238e7912a331 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:50.722450 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eec86809-ffdf-4766-b9f2-238e7912a331 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:50.722875 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eec86809-ffdf-4766-b9f2-238e7912a331 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:51.075055 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-5557db0b-4ae0-4b64-8b8f-49209b39fea2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:51.075813 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-5557db0b-4ae0-4b64-8b8f-49209b39fea2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:51.086866 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5557db0b-4ae0-4b64-8b8f-49209b39fea2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:51.086866 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5557db0b-4ae0-4b64-8b8f-49209b39fea2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:51.086866 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5557db0b-4ae0-4b64-8b8f-49209b39fea2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:51.086866 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5557db0b-4ae0-4b64-8b8f-49209b39fea2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:51.397243 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-5557db0b-4ae0-4b64-8b8f-49209b39fea2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:51.406640 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-5557db0b-4ae0-4b64-8b8f-49209b39fea2 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1372 microversion: 2.1 time: 0.335410 Jun 20 14:54:51.406951 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-eec86809-ffdf-4766-b9f2-238e7912a331 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "POST /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703301 Jun 20 14:54:51.407740 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 182/372] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 14:54:50 2022] POST /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:51.408239 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 191/373] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:51 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1372 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:51.918669 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-044c9df8-9d43-4f0f-95c5-0d017d516550 req-ab495e96-1ae3-4711-be2d-a2e7e558d9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbec336a-d2a1-4417-ae64-bf09da7cceda", "tag": "e9da401c-2faa-4ed5-ba47-172b7b568c5a"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:51.926821 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-044c9df8-9d43-4f0f-95c5-0d017d516550 req-ab495e96-1ae3-4711-be2d-a2e7e558d9c0 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:51.927257 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-044c9df8-9d43-4f0f-95c5-0d017d516550 req-ab495e96-1ae3-4711-be2d-a2e7e558d9c0 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:51.938335 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-044c9df8-9d43-4f0f-95c5-0d017d516550 req-ab495e96-1ae3-4711-be2d-a2e7e558d9c0 service nova] Creating event network-changed:e9da401c-2faa-4ed5-ba47-172b7b568c5a for instance cbec336a-d2a1-4417-ae64-bf09da7cceda on hv-cinder-83697 Jun 20 14:54:51.943590 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-044c9df8-9d43-4f0f-95c5-0d017d516550 req-ab495e96-1ae3-4711-be2d-a2e7e558d9c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029121 Jun 20 14:54:51.944184 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 183/374] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:52.428154 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-bc1802a3-7879-40c8-a8a4-8ac54d5f01d8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:52.429455 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-bc1802a3-7879-40c8-a8a4-8ac54d5f01d8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:52.440956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bc1802a3-7879-40c8-a8a4-8ac54d5f01d8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:52.441409 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bc1802a3-7879-40c8-a8a4-8ac54d5f01d8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:52.442185 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bc1802a3-7879-40c8-a8a4-8ac54d5f01d8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:52.442617 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bc1802a3-7879-40c8-a8a4-8ac54d5f01d8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:52.616228 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-bc1802a3-7879-40c8-a8a4-8ac54d5f01d8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:54:52.623914 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-bc1802a3-7879-40c8-a8a4-8ac54d5f01d8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1566 microversion: 2.1 time: 0.199988 Jun 20 14:54:52.624520 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 192/375] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:54:52 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:54:52.642328 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-8c3e3241-1e2c-47cf-9585-1746b191be33 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:54:52.642928 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-8c3e3241-1e2c-47cf-9585-1746b191be33 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:54:52.649828 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8c3e3241-1e2c-47cf-9585-1746b191be33 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:52.650271 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8c3e3241-1e2c-47cf-9585-1746b191be33 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:52.651028 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8c3e3241-1e2c-47cf-9585-1746b191be33 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:52.651651 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8c3e3241-1e2c-47cf-9585-1746b191be33 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:52.748205 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-8c3e3241-1e2c-47cf-9585-1746b191be33 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110558 Jun 20 14:54:52.748787 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 184/376] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 14:54:52 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:54:53.957657 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-f4293aa7-e94a-443b-9fb1-240270470da0 req-381451ba-339f-4d6b-bed1-ced06538ff91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68161747-6331-4819-a01b-24d3d5e80563", "tag": "ba17c8d3-ed5f-4cf2-8dbe-b795150fcdf8"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:54:53.967010 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-f4293aa7-e94a-443b-9fb1-240270470da0 req-381451ba-339f-4d6b-bed1-ced06538ff91 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:54:53.967442 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-f4293aa7-e94a-443b-9fb1-240270470da0 req-381451ba-339f-4d6b-bed1-ced06538ff91 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:54:53.978912 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-f4293aa7-e94a-443b-9fb1-240270470da0 req-381451ba-339f-4d6b-bed1-ced06538ff91 service nova] Creating event network-changed:ba17c8d3-ed5f-4cf2-8dbe-b795150fcdf8 for instance 68161747-6331-4819-a01b-24d3d5e80563 on hv-cinder-83697 Jun 20 14:54:53.983916 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-f4293aa7-e94a-443b-9fb1-240270470da0 req-381451ba-339f-4d6b-bed1-ced06538ff91 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029948 Jun 20 14:54:53.984541 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 193/377] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:55:04.339062 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:04.339906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=29 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:04.340741 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:04.344603 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-a06bbdda-86ad-48e0-a1ab-bb0bba480a5e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:04.345238 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-a06bbdda-86ad-48e0-a1ab-bb0bba480a5e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:04.352988 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a06bbdda-86ad-48e0-a1ab-bb0bba480a5e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:04.353414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a06bbdda-86ad-48e0-a1ab-bb0bba480a5e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:04.354169 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a06bbdda-86ad-48e0-a1ab-bb0bba480a5e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:04.354610 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a06bbdda-86ad-48e0-a1ab-bb0bba480a5e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:04.481709 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=45 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:04.482465 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=43 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:04.487580 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1a598329-2ca3-4059-a8b2-84b891b976e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:04.487752 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-a06bbdda-86ad-48e0-a1ab-bb0bba480a5e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:04.488184 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-1a598329-2ca3-4059-a8b2-84b891b976e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:04.495911 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1a598329-2ca3-4059-a8b2-84b891b976e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:04.496150 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-a06bbdda-86ad-48e0-a1ab-bb0bba480a5e tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1596 microversion: 2.1 time: 0.158602 Jun 20 14:55:04.496346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1a598329-2ca3-4059-a8b2-84b891b976e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:04.496737 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 185/378] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:04 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1596 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:04.497143 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1a598329-2ca3-4059-a8b2-84b891b976e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:04.497643 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1a598329-2ca3-4059-a8b2-84b891b976e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:04.522273 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1a598329-2ca3-4059-a8b2-84b891b976e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/ips" status: 200 len: 152 microversion: 2.20 time: 0.042471 Jun 20 14:55:04.522900 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 194/379] 10.222.0.23 () {60 vars in 1288 bytes} [Mon Jun 20 14:55:04 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:55:06.307727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-aee344b3-7e46-4abd-9d72-6211241947a5 req-2fbd35fa-4b0d-40d9-a553-ab049233cace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e28018-9057-44e5-a730-871114cf6249", "tag": "6ee3c9d3-8185-4e24-b29a-20f7ceb97549"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:06.328963 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-aee344b3-7e46-4abd-9d72-6211241947a5 req-2fbd35fa-4b0d-40d9-a553-ab049233cace service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:06.329267 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-aee344b3-7e46-4abd-9d72-6211241947a5 req-2fbd35fa-4b0d-40d9-a553-ab049233cace service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:06.341253 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-aee344b3-7e46-4abd-9d72-6211241947a5 req-2fbd35fa-4b0d-40d9-a553-ab049233cace service nova] Creating event network-changed:6ee3c9d3-8185-4e24-b29a-20f7ceb97549 for instance 33e28018-9057-44e5-a730-871114cf6249 on hv-cinder-83697 Jun 20 14:55:06.346535 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-aee344b3-7e46-4abd-9d72-6211241947a5 req-2fbd35fa-4b0d-40d9-a553-ab049233cace service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042715 Jun 20 14:55:06.347181 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 186/380] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:55:07.351198 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-11a5c21f-22f4-4d4a-94a5-d8204a031bd3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:07.351817 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-11a5c21f-22f4-4d4a-94a5-d8204a031bd3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:07.362406 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-11a5c21f-22f4-4d4a-94a5-d8204a031bd3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:07.362876 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-11a5c21f-22f4-4d4a-94a5-d8204a031bd3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:07.363848 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-11a5c21f-22f4-4d4a-94a5-d8204a031bd3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:07.364883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-11a5c21f-22f4-4d4a-94a5-d8204a031bd3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:07.402078 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.objects.instance [None req-11a5c21f-22f4-4d4a-94a5-d8204a031bd3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lazy-loading 'flavor' on Instance uuid 916159e1-4580-4bb4-a78f-857e9e15c61b {{(pid=123979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:55:07.417874 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-5fcc6e91-3a5c-4198-b1b9-9d4cf95eb4c2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-57145943"}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:07.418587 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-5fcc6e91-3a5c-4198-b1b9-9d4cf95eb4c2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:07.426396 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5fcc6e91-3a5c-4198-b1b9-9d4cf95eb4c2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:07.426937 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5fcc6e91-3a5c-4198-b1b9-9d4cf95eb4c2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:07.427937 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5fcc6e91-3a5c-4198-b1b9-9d4cf95eb4c2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:07.428396 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5fcc6e91-3a5c-4198-b1b9-9d4cf95eb4c2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:07.689428 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-11a5c21f-22f4-4d4a-94a5-d8204a031bd3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "POST /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/action" status: 202 len: 0 microversion: 2.20 time: 0.357997 Jun 20 14:55:07.690099 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 195/381] 10.222.0.23 () {62 vars in 1318 bytes} [Mon Jun 20 14:55:07 2022] POST /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:55:07.698999 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-78d22a0a-9848-4920-8cec-a79e5ea794e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:07.699810 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-78d22a0a-9848-4920-8cec-a79e5ea794e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:07.706731 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-78d22a0a-9848-4920-8cec-a79e5ea794e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:07.707172 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-78d22a0a-9848-4920-8cec-a79e5ea794e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:07.707958 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-78d22a0a-9848-4920-8cec-a79e5ea794e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:07.708482 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-78d22a0a-9848-4920-8cec-a79e5ea794e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:07.841317 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.network.security_group_api [None req-5fcc6e91-3a5c-4198-b1b9-9d4cf95eb4c2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Adding security group b3c2f0ba-21f4-4695-aed2-061b56177e1f to port 6ee3c9d3-8185-4e24-b29a-20f7ceb97549 Jun 20 14:55:07.844334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-78d22a0a-9848-4920-8cec-a79e5ea794e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:07.853107 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-78d22a0a-9848-4920-8cec-a79e5ea794e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:07.854578 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-78d22a0a-9848-4920-8cec-a79e5ea794e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:07.855794 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-78d22a0a-9848-4920-8cec-a79e5ea794e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.161141 Jun 20 14:55:07.856356 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 196/382] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:07 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:08.428982 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-5fcc6e91-3a5c-4198-b1b9-9d4cf95eb4c2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "POST /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/action" status: 202 len: 0 microversion: 2.1 time: 1.017472 Jun 20 14:55:08.434178 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 187/383] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 14:55:07 2022] POST /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/action => generated 0 bytes in 1024 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 14:55:08.440698 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-71f4b841-6570-45d7-8c05-a9455678a7f3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:08.441618 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-71f4b841-6570-45d7-8c05-a9455678a7f3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:08.442027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-86efd8c7-a2c2-4b74-af7a-a7918611938c req-2403477b-de60-4a69-a2c5-163fa0da809b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e28018-9057-44e5-a730-871114cf6249", "tag": "6ee3c9d3-8185-4e24-b29a-20f7ceb97549"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:08.449986 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-71f4b841-6570-45d7-8c05-a9455678a7f3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:08.450789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-71f4b841-6570-45d7-8c05-a9455678a7f3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:08.451867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-71f4b841-6570-45d7-8c05-a9455678a7f3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:08.452499 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-71f4b841-6570-45d7-8c05-a9455678a7f3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:08.453289 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-86efd8c7-a2c2-4b74-af7a-a7918611938c req-2403477b-de60-4a69-a2c5-163fa0da809b service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:08.453950 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-86efd8c7-a2c2-4b74-af7a-a7918611938c req-2403477b-de60-4a69-a2c5-163fa0da809b service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:08.470876 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-86efd8c7-a2c2-4b74-af7a-a7918611938c req-2403477b-de60-4a69-a2c5-163fa0da809b service nova] Creating event network-changed:6ee3c9d3-8185-4e24-b29a-20f7ceb97549 for instance 33e28018-9057-44e5-a730-871114cf6249 on hv-cinder-83697 Jun 20 14:55:08.481496 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-86efd8c7-a2c2-4b74-af7a-a7918611938c req-2403477b-de60-4a69-a2c5-163fa0da809b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048537 Jun 20 14:55:08.482818 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 197/384] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 14:55:08.749612 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-71f4b841-6570-45d7-8c05-a9455678a7f3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:08.760305 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-71f4b841-6570-45d7-8c05-a9455678a7f3 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1759 microversion: 2.1 time: 0.324712 Jun 20 14:55:08.761150 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 188/385] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:08 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1759 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:08.875981 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d910eba3-a2a0-45cb-8730-368946b13749 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:08.876568 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d910eba3-a2a0-45cb-8730-368946b13749 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:08.883776 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d910eba3-a2a0-45cb-8730-368946b13749 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:08.884226 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d910eba3-a2a0-45cb-8730-368946b13749 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:08.885034 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d910eba3-a2a0-45cb-8730-368946b13749 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:08.885469 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d910eba3-a2a0-45cb-8730-368946b13749 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:09.052178 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d910eba3-a2a0-45cb-8730-368946b13749 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:09.062279 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d910eba3-a2a0-45cb-8730-368946b13749 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:09.065099 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d910eba3-a2a0-45cb-8730-368946b13749 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:09.066512 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d910eba3-a2a0-45cb-8730-368946b13749 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.194996 Jun 20 14:55:09.068520 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 198/386] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:08 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:10.086617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c304a052-64cf-42f7-b460-09a7e85b43b4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:10.087196 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-c304a052-64cf-42f7-b460-09a7e85b43b4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:10.093950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c304a052-64cf-42f7-b460-09a7e85b43b4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:10.094395 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c304a052-64cf-42f7-b460-09a7e85b43b4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:10.095149 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c304a052-64cf-42f7-b460-09a7e85b43b4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:10.095579 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c304a052-64cf-42f7-b460-09a7e85b43b4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:10.236652 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-c304a052-64cf-42f7-b460-09a7e85b43b4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:10.247369 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-c304a052-64cf-42f7-b460-09a7e85b43b4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:10.249768 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-c304a052-64cf-42f7-b460-09a7e85b43b4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:10.251251 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-c304a052-64cf-42f7-b460-09a7e85b43b4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.168383 Jun 20 14:55:10.252015 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 189/387] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:10 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:11.273585 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-78040f99-a47e-4973-acb1-93eb11697726 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:11.274182 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-78040f99-a47e-4973-acb1-93eb11697726 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:11.281548 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-78040f99-a47e-4973-acb1-93eb11697726 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:11.281956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-78040f99-a47e-4973-acb1-93eb11697726 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:11.282766 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-78040f99-a47e-4973-acb1-93eb11697726 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:11.283224 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-78040f99-a47e-4973-acb1-93eb11697726 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:11.421976 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-78040f99-a47e-4973-acb1-93eb11697726 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:11.430604 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-78040f99-a47e-4973-acb1-93eb11697726 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:11.432104 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-78040f99-a47e-4973-acb1-93eb11697726 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:11.433296 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-78040f99-a47e-4973-acb1-93eb11697726 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.165812 Jun 20 14:55:11.433838 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 199/388] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:11 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:12.453374 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-4e19853b-d445-4e08-84f4-808cbef0208d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:12.454090 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-4e19853b-d445-4e08-84f4-808cbef0208d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:12.461287 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e19853b-d445-4e08-84f4-808cbef0208d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:12.461725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e19853b-d445-4e08-84f4-808cbef0208d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:12.462517 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e19853b-d445-4e08-84f4-808cbef0208d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:12.462955 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4e19853b-d445-4e08-84f4-808cbef0208d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:12.624961 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-4e19853b-d445-4e08-84f4-808cbef0208d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:12.633932 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-4e19853b-d445-4e08-84f4-808cbef0208d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:12.635389 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-4e19853b-d445-4e08-84f4-808cbef0208d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:12.636534 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-4e19853b-d445-4e08-84f4-808cbef0208d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.187261 Jun 20 14:55:12.637124 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 190/389] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:12 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:13.656135 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-29b5a559-7fa1-4ebe-a871-ca3bb34ec3f5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:13.656777 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-29b5a559-7fa1-4ebe-a871-ca3bb34ec3f5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:13.664058 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-29b5a559-7fa1-4ebe-a871-ca3bb34ec3f5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:13.664499 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-29b5a559-7fa1-4ebe-a871-ca3bb34ec3f5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:13.665289 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-29b5a559-7fa1-4ebe-a871-ca3bb34ec3f5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:13.665717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-29b5a559-7fa1-4ebe-a871-ca3bb34ec3f5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:13.802567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-29b5a559-7fa1-4ebe-a871-ca3bb34ec3f5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:13.811222 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-29b5a559-7fa1-4ebe-a871-ca3bb34ec3f5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:13.813584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-29b5a559-7fa1-4ebe-a871-ca3bb34ec3f5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:13.814875 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-29b5a559-7fa1-4ebe-a871-ca3bb34ec3f5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.162683 Jun 20 14:55:13.815516 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 200/390] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:13 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:14.832852 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-5a20bac5-372f-42f7-b2d1-6b103699cd54 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:14.833458 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-5a20bac5-372f-42f7-b2d1-6b103699cd54 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:14.839774 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5a20bac5-372f-42f7-b2d1-6b103699cd54 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:14.840219 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5a20bac5-372f-42f7-b2d1-6b103699cd54 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:14.840997 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5a20bac5-372f-42f7-b2d1-6b103699cd54 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:14.841423 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5a20bac5-372f-42f7-b2d1-6b103699cd54 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:14.973546 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-5a20bac5-372f-42f7-b2d1-6b103699cd54 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:14.981850 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-5a20bac5-372f-42f7-b2d1-6b103699cd54 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:14.983343 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-5a20bac5-372f-42f7-b2d1-6b103699cd54 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:14.984479 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-5a20bac5-372f-42f7-b2d1-6b103699cd54 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.156144 Jun 20 14:55:14.985048 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 191/391] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:14 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:16.006632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2f5807af-56b6-4f35-a0c8-b3841366842a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:16.007701 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-2f5807af-56b6-4f35-a0c8-b3841366842a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:16.019165 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2f5807af-56b6-4f35-a0c8-b3841366842a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:16.019899 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2f5807af-56b6-4f35-a0c8-b3841366842a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:16.021217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2f5807af-56b6-4f35-a0c8-b3841366842a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:16.021966 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2f5807af-56b6-4f35-a0c8-b3841366842a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:16.163044 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-2f5807af-56b6-4f35-a0c8-b3841366842a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:16.171662 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-2f5807af-56b6-4f35-a0c8-b3841366842a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:16.173174 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-2f5807af-56b6-4f35-a0c8-b3841366842a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:16.174329 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-2f5807af-56b6-4f35-a0c8-b3841366842a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.174148 Jun 20 14:55:16.174882 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 201/392] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:15 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:17.195022 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3447af33-c44d-4f59-a2c7-e772bc09251c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:17.195613 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-3447af33-c44d-4f59-a2c7-e772bc09251c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:17.202592 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3447af33-c44d-4f59-a2c7-e772bc09251c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:17.203056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3447af33-c44d-4f59-a2c7-e772bc09251c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:17.203791 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3447af33-c44d-4f59-a2c7-e772bc09251c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:17.204219 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3447af33-c44d-4f59-a2c7-e772bc09251c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:17.342369 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3447af33-c44d-4f59-a2c7-e772bc09251c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:17.350904 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3447af33-c44d-4f59-a2c7-e772bc09251c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:17.352407 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3447af33-c44d-4f59-a2c7-e772bc09251c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:17.353581 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-3447af33-c44d-4f59-a2c7-e772bc09251c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.163249 Jun 20 14:55:17.354146 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 192/393] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:17 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:18.373365 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2da749ab-0dba-4224-b296-aa48ef86fab7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:18.373953 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-2da749ab-0dba-4224-b296-aa48ef86fab7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:18.381405 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2da749ab-0dba-4224-b296-aa48ef86fab7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:18.381849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2da749ab-0dba-4224-b296-aa48ef86fab7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:18.382616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2da749ab-0dba-4224-b296-aa48ef86fab7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:18.383040 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2da749ab-0dba-4224-b296-aa48ef86fab7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:18.535242 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-2da749ab-0dba-4224-b296-aa48ef86fab7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:18.546158 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-2da749ab-0dba-4224-b296-aa48ef86fab7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:18.547641 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-2da749ab-0dba-4224-b296-aa48ef86fab7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:18.548824 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-2da749ab-0dba-4224-b296-aa48ef86fab7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.179694 Jun 20 14:55:18.549386 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 202/394] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:18 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:19.579376 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-03c2c1b7-d5d6-4215-b30b-a57a74dca46a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:19.580505 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-03c2c1b7-d5d6-4215-b30b-a57a74dca46a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:19.590081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-03c2c1b7-d5d6-4215-b30b-a57a74dca46a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:19.590530 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-03c2c1b7-d5d6-4215-b30b-a57a74dca46a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:19.591284 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-03c2c1b7-d5d6-4215-b30b-a57a74dca46a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:19.591718 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-03c2c1b7-d5d6-4215-b30b-a57a74dca46a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:19.719750 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-03c2c1b7-d5d6-4215-b30b-a57a74dca46a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:19.727947 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-03c2c1b7-d5d6-4215-b30b-a57a74dca46a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:19.729487 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-03c2c1b7-d5d6-4215-b30b-a57a74dca46a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:19.730637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-03c2c1b7-d5d6-4215-b30b-a57a74dca46a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.157825 Jun 20 14:55:19.731207 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 193/395] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:19 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:20.753004 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e809f697-1365-450b-a8ea-cb61271311c7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:20.754058 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e809f697-1365-450b-a8ea-cb61271311c7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:20.762957 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e809f697-1365-450b-a8ea-cb61271311c7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:20.763480 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e809f697-1365-450b-a8ea-cb61271311c7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:20.764122 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e809f697-1365-450b-a8ea-cb61271311c7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:20.764546 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e809f697-1365-450b-a8ea-cb61271311c7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:20.911640 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e809f697-1365-450b-a8ea-cb61271311c7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:20.920543 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e809f697-1365-450b-a8ea-cb61271311c7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:20.922077 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e809f697-1365-450b-a8ea-cb61271311c7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:20.923227 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e809f697-1365-450b-a8ea-cb61271311c7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.176945 Jun 20 14:55:20.923793 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 203/396] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:20 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:21.946317 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-8722aa4f-1130-44f6-bcb6-59656d8afbc7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:21.947516 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-8722aa4f-1130-44f6-bcb6-59656d8afbc7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:21.958199 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8722aa4f-1130-44f6-bcb6-59656d8afbc7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:21.958920 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8722aa4f-1130-44f6-bcb6-59656d8afbc7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:21.960163 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8722aa4f-1130-44f6-bcb6-59656d8afbc7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:21.960941 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8722aa4f-1130-44f6-bcb6-59656d8afbc7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:22.098429 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-8722aa4f-1130-44f6-bcb6-59656d8afbc7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:22.110257 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-8722aa4f-1130-44f6-bcb6-59656d8afbc7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:22.112560 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-8722aa4f-1130-44f6-bcb6-59656d8afbc7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:22.113842 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-8722aa4f-1130-44f6-bcb6-59656d8afbc7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.174190 Jun 20 14:55:22.114589 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 194/397] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:21 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:23.135243 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-047d361c-8fe5-498d-9c38-776d07e5f951 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:23.135799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-047d361c-8fe5-498d-9c38-776d07e5f951 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:23.142869 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-047d361c-8fe5-498d-9c38-776d07e5f951 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:23.143316 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-047d361c-8fe5-498d-9c38-776d07e5f951 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:23.144084 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-047d361c-8fe5-498d-9c38-776d07e5f951 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:23.144512 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-047d361c-8fe5-498d-9c38-776d07e5f951 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:23.282088 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-047d361c-8fe5-498d-9c38-776d07e5f951 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:23.294314 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-047d361c-8fe5-498d-9c38-776d07e5f951 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:23.296636 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-047d361c-8fe5-498d-9c38-776d07e5f951 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:23.298270 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-047d361c-8fe5-498d-9c38-776d07e5f951 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.167061 Jun 20 14:55:23.298880 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 204/398] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:23 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:24.323489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-11ffdd6b-7553-4856-be20-e25d19a1163d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:24.324370 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-11ffdd6b-7553-4856-be20-e25d19a1163d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:24.335478 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-11ffdd6b-7553-4856-be20-e25d19a1163d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:24.336158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-11ffdd6b-7553-4856-be20-e25d19a1163d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:24.337355 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-11ffdd6b-7553-4856-be20-e25d19a1163d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:24.337777 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-11ffdd6b-7553-4856-be20-e25d19a1163d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:24.471567 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-11ffdd6b-7553-4856-be20-e25d19a1163d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:24.479813 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-11ffdd6b-7553-4856-be20-e25d19a1163d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:24.481335 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-11ffdd6b-7553-4856-be20-e25d19a1163d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:24.482471 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-11ffdd6b-7553-4856-be20-e25d19a1163d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.165791 Jun 20 14:55:24.483036 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 195/399] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:24 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:55:25.503539 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-923577aa-037a-454e-b96b-53b63e2a1d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:25.504121 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-923577aa-037a-454e-b96b-53b63e2a1d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:25.514518 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-923577aa-037a-454e-b96b-53b63e2a1d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:25.515174 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-923577aa-037a-454e-b96b-53b63e2a1d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:25.516346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-923577aa-037a-454e-b96b-53b63e2a1d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:25.517018 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-923577aa-037a-454e-b96b-53b63e2a1d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:25.652945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-923577aa-037a-454e-b96b-53b63e2a1d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:25.661410 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-923577aa-037a-454e-b96b-53b63e2a1d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:25.662939 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-923577aa-037a-454e-b96b-53b63e2a1d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:25.664112 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-923577aa-037a-454e-b96b-53b63e2a1d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.166589 Jun 20 14:55:25.664674 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 205/400] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:25 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:26.687595 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6aca1764-01dc-4220-ba03-6fa5f0c732b7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:26.689029 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6aca1764-01dc-4220-ba03-6fa5f0c732b7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:26.698879 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6aca1764-01dc-4220-ba03-6fa5f0c732b7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:26.699317 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6aca1764-01dc-4220-ba03-6fa5f0c732b7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:26.700066 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6aca1764-01dc-4220-ba03-6fa5f0c732b7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:26.700491 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6aca1764-01dc-4220-ba03-6fa5f0c732b7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:26.833219 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-6aca1764-01dc-4220-ba03-6fa5f0c732b7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:26.841619 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-6aca1764-01dc-4220-ba03-6fa5f0c732b7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:26.843119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-6aca1764-01dc-4220-ba03-6fa5f0c732b7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:26.844261 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6aca1764-01dc-4220-ba03-6fa5f0c732b7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.163646 Jun 20 14:55:26.844839 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 196/401] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:26 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:27.864186 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d8e5d02d-fcca-4ce9-9c89-0e7ab8ad22bd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:27.864889 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d8e5d02d-fcca-4ce9-9c89-0e7ab8ad22bd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:27.872858 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d8e5d02d-fcca-4ce9-9c89-0e7ab8ad22bd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:27.873304 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d8e5d02d-fcca-4ce9-9c89-0e7ab8ad22bd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:27.874063 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d8e5d02d-fcca-4ce9-9c89-0e7ab8ad22bd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:27.874493 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d8e5d02d-fcca-4ce9-9c89-0e7ab8ad22bd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:28.017519 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d8e5d02d-fcca-4ce9-9c89-0e7ab8ad22bd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:28.025663 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d8e5d02d-fcca-4ce9-9c89-0e7ab8ad22bd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:28.027407 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d8e5d02d-fcca-4ce9-9c89-0e7ab8ad22bd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:28.028339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d8e5d02d-fcca-4ce9-9c89-0e7ab8ad22bd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.168828 Jun 20 14:55:28.028927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 206/402] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:27 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:29.049775 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-9fd1af7d-6a43-4a99-9fb1-ed6629e263a4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:29.050395 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-9fd1af7d-6a43-4a99-9fb1-ed6629e263a4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:29.061184 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9fd1af7d-6a43-4a99-9fb1-ed6629e263a4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:29.061774 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9fd1af7d-6a43-4a99-9fb1-ed6629e263a4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:29.063302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9fd1af7d-6a43-4a99-9fb1-ed6629e263a4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:29.063826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9fd1af7d-6a43-4a99-9fb1-ed6629e263a4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:29.206909 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-9fd1af7d-6a43-4a99-9fb1-ed6629e263a4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:29.215344 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-9fd1af7d-6a43-4a99-9fb1-ed6629e263a4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:29.216920 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-9fd1af7d-6a43-4a99-9fb1-ed6629e263a4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:29.218238 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-9fd1af7d-6a43-4a99-9fb1-ed6629e263a4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1746 microversion: 2.20 time: 0.174499 Jun 20 14:55:29.218800 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 197/403] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:29 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1746 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:30.239841 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0e4e5936-71e9-47d8-b4f1-885200d943e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:30.240687 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-0e4e5936-71e9-47d8-b4f1-885200d943e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:30.250884 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0e4e5936-71e9-47d8-b4f1-885200d943e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:30.251520 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0e4e5936-71e9-47d8-b4f1-885200d943e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:30.252684 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0e4e5936-71e9-47d8-b4f1-885200d943e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:30.253401 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0e4e5936-71e9-47d8-b4f1-885200d943e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:30.388141 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0e4e5936-71e9-47d8-b4f1-885200d943e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:30.396546 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0e4e5936-71e9-47d8-b4f1-885200d943e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:30.398083 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0e4e5936-71e9-47d8-b4f1-885200d943e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:30.399271 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0e4e5936-71e9-47d8-b4f1-885200d943e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1746 microversion: 2.20 time: 0.165721 Jun 20 14:55:30.400066 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 207/404] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:30 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:31.382220 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d8d38235-a2fa-421b-978f-497c5d1043fb tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:31.383259 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-d8d38235-a2fa-421b-978f-497c5d1043fb tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:31.393206 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d8d38235-a2fa-421b-978f-497c5d1043fb tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:31.393654 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d8d38235-a2fa-421b-978f-497c5d1043fb tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:31.394458 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d8d38235-a2fa-421b-978f-497c5d1043fb tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:31.394902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d8d38235-a2fa-421b-978f-497c5d1043fb tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:31.420727 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8d1768b4-158e-48a2-abc2-dacd02fb3a05 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:31.421787 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-8d1768b4-158e-48a2-abc2-dacd02fb3a05 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:31.430987 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8d1768b4-158e-48a2-abc2-dacd02fb3a05 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:31.432433 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8d1768b4-158e-48a2-abc2-dacd02fb3a05 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:31.433317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8d1768b4-158e-48a2-abc2-dacd02fb3a05 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:31.433759 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8d1768b4-158e-48a2-abc2-dacd02fb3a05 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:31.495130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d8d38235-a2fa-421b-978f-497c5d1043fb tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "POST /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/action" status: 202 len: 0 microversion: 2.1 time: 0.114938 Jun 20 14:55:31.500419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 198/405] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 14:55:31 2022] POST /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 14:55:31.506225 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6a0a0e96-dd8a-4e55-a1e7-82487b80736b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:31.507057 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6a0a0e96-dd8a-4e55-a1e7-82487b80736b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:31.515890 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6a0a0e96-dd8a-4e55-a1e7-82487b80736b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:31.516265 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6a0a0e96-dd8a-4e55-a1e7-82487b80736b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:31.517763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6a0a0e96-dd8a-4e55-a1e7-82487b80736b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:31.518315 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6a0a0e96-dd8a-4e55-a1e7-82487b80736b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:31.600856 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8d1768b4-158e-48a2-abc2-dacd02fb3a05 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:31.610072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8d1768b4-158e-48a2-abc2-dacd02fb3a05 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:31.611643 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8d1768b4-158e-48a2-abc2-dacd02fb3a05 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:31.612858 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-8d1768b4-158e-48a2-abc2-dacd02fb3a05 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1741 microversion: 2.20 time: 0.199158 Jun 20 14:55:31.616763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 208/406] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:31 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:31.809147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-6a0a0e96-dd8a-4e55-a1e7-82487b80736b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:31.818585 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6a0a0e96-dd8a-4e55-a1e7-82487b80736b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1751 microversion: 2.1 time: 0.316473 Jun 20 14:55:31.828929 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 199/407] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:31 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1751 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:32.633046 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-038fc102-c6e1-4315-9895-580a68530339 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:32.633638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-038fc102-c6e1-4315-9895-580a68530339 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:32.640085 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-038fc102-c6e1-4315-9895-580a68530339 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:32.640541 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-038fc102-c6e1-4315-9895-580a68530339 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:32.641346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-038fc102-c6e1-4315-9895-580a68530339 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:32.641779 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-038fc102-c6e1-4315-9895-580a68530339 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:32.665864 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:32.791577 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-038fc102-c6e1-4315-9895-580a68530339 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:32.800188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-038fc102-c6e1-4315-9895-580a68530339 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:32.801885 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-038fc102-c6e1-4315-9895-580a68530339 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:32.803054 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-038fc102-c6e1-4315-9895-580a68530339 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1741 microversion: 2.20 time: 0.174461 Jun 20 14:55:32.803612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 209/408] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:32 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:32.836559 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e944f6c1-cc1f-47e2-8295-43a70cbdcc5f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:32.837468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e944f6c1-cc1f-47e2-8295-43a70cbdcc5f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:32.852230 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e944f6c1-cc1f-47e2-8295-43a70cbdcc5f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:32.852692 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e944f6c1-cc1f-47e2-8295-43a70cbdcc5f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:32.853542 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e944f6c1-cc1f-47e2-8295-43a70cbdcc5f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:32.853983 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e944f6c1-cc1f-47e2-8295-43a70cbdcc5f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:33.025844 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-e944f6c1-cc1f-47e2-8295-43a70cbdcc5f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:33.035166 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e944f6c1-cc1f-47e2-8295-43a70cbdcc5f tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1756 microversion: 2.1 time: 0.202586 Jun 20 14:55:33.035952 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 200/409] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:32 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:55:33.488751 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-1223d254-4540-402b-9a45-9111e9e4c2c1 req-837f2635-3cae-4b6d-9b15-776e9161ad6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916159e1-4580-4bb4-a78f-857e9e15c61b", "name": "network-vif-plugged", "status": "completed", "tag": "4003555e-bf92-479e-b2dd-be6fe4500b56"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:33.499838 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-1223d254-4540-402b-9a45-9111e9e4c2c1 req-837f2635-3cae-4b6d-9b15-776e9161ad6f service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:33.500395 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-1223d254-4540-402b-9a45-9111e9e4c2c1 req-837f2635-3cae-4b6d-9b15-776e9161ad6f service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:33.515231 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-1223d254-4540-402b-9a45-9111e9e4c2c1 req-837f2635-3cae-4b6d-9b15-776e9161ad6f service nova] Creating event network-vif-plugged:4003555e-bf92-479e-b2dd-be6fe4500b56 for instance 916159e1-4580-4bb4-a78f-857e9e15c61b on hv-cinder-83697 Jun 20 14:55:33.522704 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-1223d254-4540-402b-9a45-9111e9e4c2c1 req-837f2635-3cae-4b6d-9b15-776e9161ad6f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038744 Jun 20 14:55:33.523649 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 210/410] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:55:33.824649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2b64422d-18d3-4f61-8479-5cf9a92b8be2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:33.826255 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2b64422d-18d3-4f61-8479-5cf9a92b8be2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:33.833223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2b64422d-18d3-4f61-8479-5cf9a92b8be2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:33.833660 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2b64422d-18d3-4f61-8479-5cf9a92b8be2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:33.834418 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2b64422d-18d3-4f61-8479-5cf9a92b8be2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:33.834839 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2b64422d-18d3-4f61-8479-5cf9a92b8be2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:33.855908 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:33.989442 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2b64422d-18d3-4f61-8479-5cf9a92b8be2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:33.999909 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2b64422d-18d3-4f61-8479-5cf9a92b8be2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:34.001781 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2b64422d-18d3-4f61-8479-5cf9a92b8be2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:34.002946 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2b64422d-18d3-4f61-8479-5cf9a92b8be2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1741 microversion: 2.20 time: 0.183261 Jun 20 14:55:34.003827 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 201/411] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:33 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:34.053884 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b973e239-7044-4031-a0c1-652743df92b4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:34.054674 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-b973e239-7044-4031-a0c1-652743df92b4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:34.062735 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b973e239-7044-4031-a0c1-652743df92b4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:34.063175 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b973e239-7044-4031-a0c1-652743df92b4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:34.063958 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b973e239-7044-4031-a0c1-652743df92b4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:34.064386 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b973e239-7044-4031-a0c1-652743df92b4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:34.259055 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-b973e239-7044-4031-a0c1-652743df92b4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:34.267536 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-b973e239-7044-4031-a0c1-652743df92b4 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1756 microversion: 2.1 time: 0.218358 Jun 20 14:55:34.268312 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 211/412] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:34 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1756 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:35.029879 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-05c91fb3-5764-43b4-acfd-8b3cffa7c704 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:35.030490 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-05c91fb3-5764-43b4-acfd-8b3cffa7c704 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:35.032923 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=35 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:35.039829 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-05c91fb3-5764-43b4-acfd-8b3cffa7c704 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:35.040900 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-05c91fb3-5764-43b4-acfd-8b3cffa7c704 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:35.042355 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-05c91fb3-5764-43b4-acfd-8b3cffa7c704 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:35.042952 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-05c91fb3-5764-43b4-acfd-8b3cffa7c704 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:35.193874 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-05c91fb3-5764-43b4-acfd-8b3cffa7c704 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:35.203999 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-05c91fb3-5764-43b4-acfd-8b3cffa7c704 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:35.205543 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-05c91fb3-5764-43b4-acfd-8b3cffa7c704 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:35.206690 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-05c91fb3-5764-43b4-acfd-8b3cffa7c704 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1741 microversion: 2.20 time: 0.189401 Jun 20 14:55:35.207442 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 202/413] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:35 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:35.285098 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-bb8afee6-deec-445c-8e78-cf32d5d96c39 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:35.285644 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-bb8afee6-deec-445c-8e78-cf32d5d96c39 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:35.289231 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=37 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:35.292968 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bb8afee6-deec-445c-8e78-cf32d5d96c39 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:35.293640 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bb8afee6-deec-445c-8e78-cf32d5d96c39 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:35.294841 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bb8afee6-deec-445c-8e78-cf32d5d96c39 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:35.295308 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bb8afee6-deec-445c-8e78-cf32d5d96c39 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:35.459249 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-bb8afee6-deec-445c-8e78-cf32d5d96c39 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:35.468688 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-bb8afee6-deec-445c-8e78-cf32d5d96c39 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1756 microversion: 2.1 time: 0.187560 Jun 20 14:55:35.469837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 212/414] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:35 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:36.227587 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0f766fd5-56e2-4faf-b229-a9adc92ef616 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:36.228973 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-0f766fd5-56e2-4faf-b229-a9adc92ef616 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:36.236489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0f766fd5-56e2-4faf-b229-a9adc92ef616 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:36.237110 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0f766fd5-56e2-4faf-b229-a9adc92ef616 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:36.237855 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0f766fd5-56e2-4faf-b229-a9adc92ef616 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:36.238288 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0f766fd5-56e2-4faf-b229-a9adc92ef616 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:36.388817 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0f766fd5-56e2-4faf-b229-a9adc92ef616 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:36.397059 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0f766fd5-56e2-4faf-b229-a9adc92ef616 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:36.398737 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0f766fd5-56e2-4faf-b229-a9adc92ef616 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:36.399981 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0f766fd5-56e2-4faf-b229-a9adc92ef616 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1741 microversion: 2.20 time: 0.176457 Jun 20 14:55:36.400749 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 203/415] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:36 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:36.486718 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d3742fd7-99aa-4e4c-8f7f-d0b65da10788 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:36.488002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d3742fd7-99aa-4e4c-8f7f-d0b65da10788 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:36.495474 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d3742fd7-99aa-4e4c-8f7f-d0b65da10788 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:36.495925 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d3742fd7-99aa-4e4c-8f7f-d0b65da10788 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:36.496684 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d3742fd7-99aa-4e4c-8f7f-d0b65da10788 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:36.497136 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d3742fd7-99aa-4e4c-8f7f-d0b65da10788 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:36.665110 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d3742fd7-99aa-4e4c-8f7f-d0b65da10788 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:36.673861 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d3742fd7-99aa-4e4c-8f7f-d0b65da10788 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1756 microversion: 2.1 time: 0.191216 Jun 20 14:55:36.674462 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 213/416] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:36 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:37.418314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-dbd00188-fce8-4fdc-bc02-f9ef26078bb9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:37.418915 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-dbd00188-fce8-4fdc-bc02-f9ef26078bb9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:37.425827 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dbd00188-fce8-4fdc-bc02-f9ef26078bb9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:37.426520 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dbd00188-fce8-4fdc-bc02-f9ef26078bb9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:37.427484 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dbd00188-fce8-4fdc-bc02-f9ef26078bb9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:37.431001 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dbd00188-fce8-4fdc-bc02-f9ef26078bb9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:37.584631 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-dbd00188-fce8-4fdc-bc02-f9ef26078bb9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:37.593580 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-dbd00188-fce8-4fdc-bc02-f9ef26078bb9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:37.595098 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-dbd00188-fce8-4fdc-bc02-f9ef26078bb9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:37.596943 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-dbd00188-fce8-4fdc-bc02-f9ef26078bb9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1741 microversion: 2.20 time: 0.182677 Jun 20 14:55:37.607967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 204/417] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:37 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:37.692072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-bad84dea-4f70-463e-886b-501d5022e356 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:37.692925 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-bad84dea-4f70-463e-886b-501d5022e356 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:37.702045 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bad84dea-4f70-463e-886b-501d5022e356 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:37.702493 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bad84dea-4f70-463e-886b-501d5022e356 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:37.703276 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bad84dea-4f70-463e-886b-501d5022e356 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:37.703707 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bad84dea-4f70-463e-886b-501d5022e356 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:37.880455 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-bad84dea-4f70-463e-886b-501d5022e356 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:37.890390 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-bad84dea-4f70-463e-886b-501d5022e356 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1756 microversion: 2.1 time: 0.202521 Jun 20 14:55:37.890989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 214/418] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:37 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:38.432072 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-486176df-546d-407c-aae6-84b363b0d6ce tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3263d7f-d493-4008-9bad-8dfa10f9109c"}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:38.433416 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-486176df-546d-407c-aae6-84b363b0d6ce tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:38.441859 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-486176df-546d-407c-aae6-84b363b0d6ce tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:38.442441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-486176df-546d-407c-aae6-84b363b0d6ce tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:38.443232 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-486176df-546d-407c-aae6-84b363b0d6ce tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:38.443659 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-486176df-546d-407c-aae6-84b363b0d6ce tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:38.510764 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-930a3628-1594-4726-acc5-84cfc17c3fc2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:38.511313 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-930a3628-1594-4726-acc5-84cfc17c3fc2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:38.519841 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-930a3628-1594-4726-acc5-84cfc17c3fc2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:38.520319 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-930a3628-1594-4726-acc5-84cfc17c3fc2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:38.521205 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-930a3628-1594-4726-acc5-84cfc17c3fc2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:38.521633 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-930a3628-1594-4726-acc5-84cfc17c3fc2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:38.569922 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-930a3628-1594-4726-acc5-84cfc17c3fc2 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda/ips" status: 200 len: 150 microversion: 2.1 time: 0.062972 Jun 20 14:55:38.572942 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 215/419] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 14:55:38 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda/ips => generated 150 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 14:55:38.595426 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-847ca029-f9e4-4c6e-a487-abaefd5fd09c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b495f8d7-3575-47ec-934c-da3c81f55bf7"}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:38.596741 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-847ca029-f9e4-4c6e-a487-abaefd5fd09c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:38.603152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-847ca029-f9e4-4c6e-a487-abaefd5fd09c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:38.603602 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-847ca029-f9e4-4c6e-a487-abaefd5fd09c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:38.604698 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-847ca029-f9e4-4c6e-a487-abaefd5fd09c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:38.605158 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-847ca029-f9e4-4c6e-a487-abaefd5fd09c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:38.714534 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-847ca029-f9e4-4c6e-a487-abaefd5fd09c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] HTTP exception thrown: Invalid volume: volume b495f8d7-3575-47ec-934c-da3c81f55bf7 is already attached to instances: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-847ca029-f9e4-4c6e-a487-abaefd5fd09c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Request method failure captured: Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: POST /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda/os-volume_attachments HTTP/1.1 Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 74 Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImbz0WxD1k9ycjcFtONQioapmstd9ALeY-XOY9KWzwZRC4BzRHKOJNKseVz_SOU8X1kqkeZceHCAJurCXmzp5osSOaO2_Ehpi_atwxfvtaZZDfF13_WZ-v9TPM1dlOrXp8wu-OjE4ErE1kdNfUTWsTDESJSRneLOLv_h39cbJpuqhQ Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:55:38.716638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:55:38.723972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}] Jun 20 14:55:38.723972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:55:38.723972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:55:38.723972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:55:38.723972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:55:38.723972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:55:38.723972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:55:38.723972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 87c3f39c0bed4fadbc8a556c857baf4a Jun 20 14:55:38.723972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:55:38.723972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Jun 20 14:55:38.723972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {"volumeAttachment": {"volumeId": "b495f8d7-3575-47ec-934c-da3c81f55bf7"}} Jun 20 14:55:38.723972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Invalid volume: volume b495f8d7-3575-47ec-934c-da3c81f55bf7 is already attached to instances: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'server_id': 'cbec336a-d2a1-4417-ae64-bf09da7cceda', 'body': {'volumeAttachment': {'volumeId': 'b495f8d7-3575-47ec-934c-da3c81f55bf7'}}} Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b495f8d7-3575-47ec-934c-da3c81f55bf7 is already attached to instances: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:55:38.725584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b495f8d7-3575-47ec-934c-da3c81f55bf7 is already attached to instances: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:55:38.727567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:55:38.730765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:55:38.730765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:55:38.730765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:55:38.730765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b495f8d7-3575-47ec-934c-da3c81f55bf7 is already attached to instances: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e Jun 20 14:55:38.730765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:55:38.730765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-847ca029-f9e4-4c6e-a487-abaefd5fd09c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Returning 400 to user: Invalid volume: volume b495f8d7-3575-47ec-934c-da3c81f55bf7 is already attached to instances: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:55:38.730765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-847ca029-f9e4-4c6e-a487-abaefd5fd09c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "POST /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134964 Jun 20 14:55:38.730765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 216/420] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 14:55:38 2022] POST /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda/os-volume_attachments => generated 174 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 14:55:38.735839 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-53162d6d-0c01-4d76-b747-01606acb256d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:38.736863 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-53162d6d-0c01-4d76-b747-01606acb256d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:38.747968 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-53162d6d-0c01-4d76-b747-01606acb256d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:38.748426 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-53162d6d-0c01-4d76-b747-01606acb256d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:38.749256 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-53162d6d-0c01-4d76-b747-01606acb256d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:38.749693 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-53162d6d-0c01-4d76-b747-01606acb256d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:38.837451 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-486176df-546d-407c-aae6-84b363b0d6ce tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "POST /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412209 Jun 20 14:55:38.845761 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 205/421] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 14:55:38 2022] POST /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/os-volume_attachments => generated 194 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:55:38.876542 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3fbcab23-8983-46eb-b89b-8714dc8aa27a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:38.880521 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-3fbcab23-8983-46eb-b89b-8714dc8aa27a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:38.897960 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3fbcab23-8983-46eb-b89b-8714dc8aa27a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:38.898455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3fbcab23-8983-46eb-b89b-8714dc8aa27a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:38.900037 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3fbcab23-8983-46eb-b89b-8714dc8aa27a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:38.903200 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3fbcab23-8983-46eb-b89b-8714dc8aa27a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:38.967112 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-3fbcab23-8983-46eb-b89b-8714dc8aa27a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 14:55:38.994563 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-53162d6d-0c01-4d76-b747-01606acb256d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:39.003026 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-53162d6d-0c01-4d76-b747-01606acb256d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:39.005773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-53162d6d-0c01-4d76-b747-01606acb256d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:39.006983 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-53162d6d-0c01-4d76-b747-01606acb256d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1741 microversion: 2.20 time: 0.280801 Jun 20 14:55:39.007547 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 217/422] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:38 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1741 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:39.017156 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-bc284efa-687c-4171-9d37-ba04edb2545a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:39.017156 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-bc284efa-687c-4171-9d37-ba04edb2545a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:39.024135 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bc284efa-687c-4171-9d37-ba04edb2545a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:39.024652 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bc284efa-687c-4171-9d37-ba04edb2545a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:39.025625 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bc284efa-687c-4171-9d37-ba04edb2545a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:39.026003 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bc284efa-687c-4171-9d37-ba04edb2545a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:39.117507 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-3fbcab23-8983-46eb-b89b-8714dc8aa27a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 204 len: 0 microversion: 2.1 time: 0.260823 Jun 20 14:55:39.118486 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 206/423] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:55:38 2022] DELETE /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:55:39.141498 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1f9d8f9e-cac4-4a7b-8c27-18b29c1d6f13 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:39.142374 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1f9d8f9e-cac4-4a7b-8c27-18b29c1d6f13 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:39.149474 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1f9d8f9e-cac4-4a7b-8c27-18b29c1d6f13 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:39.150038 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1f9d8f9e-cac4-4a7b-8c27-18b29c1d6f13 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:39.151491 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1f9d8f9e-cac4-4a7b-8c27-18b29c1d6f13 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:39.152013 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1f9d8f9e-cac4-4a7b-8c27-18b29c1d6f13 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:39.198528 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-bc284efa-687c-4171-9d37-ba04edb2545a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:39.206897 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-bc284efa-687c-4171-9d37-ba04edb2545a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1756 microversion: 2.1 time: 0.198185 Jun 20 14:55:39.208052 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 218/424] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:39 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:39.301666 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1f9d8f9e-cac4-4a7b-8c27-18b29c1d6f13 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:39.310996 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1f9d8f9e-cac4-4a7b-8c27-18b29c1d6f13 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1682 microversion: 2.1 time: 0.174309 Jun 20 14:55:39.321674 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 207/425] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:39 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:40.029596 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-c8982b44-6965-42ab-9e00-2157f240db62 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:40.030244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-c8982b44-6965-42ab-9e00-2157f240db62 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:40.040208 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c8982b44-6965-42ab-9e00-2157f240db62 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:40.040800 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c8982b44-6965-42ab-9e00-2157f240db62 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:40.041652 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c8982b44-6965-42ab-9e00-2157f240db62 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:40.042176 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c8982b44-6965-42ab-9e00-2157f240db62 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:40.190405 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-c8982b44-6965-42ab-9e00-2157f240db62 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:40.199699 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-c8982b44-6965-42ab-9e00-2157f240db62 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:40.201244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-c8982b44-6965-42ab-9e00-2157f240db62 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:40.202567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-c8982b44-6965-42ab-9e00-2157f240db62 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1741 microversion: 2.20 time: 0.179426 Jun 20 14:55:40.203133 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 219/426] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:40 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:40.223356 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7e73966a-ac7d-4012-bfba-26f737d0ee7d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:40.224003 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7e73966a-ac7d-4012-bfba-26f737d0ee7d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:40.230701 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7e73966a-ac7d-4012-bfba-26f737d0ee7d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:40.231137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7e73966a-ac7d-4012-bfba-26f737d0ee7d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:40.232009 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7e73966a-ac7d-4012-bfba-26f737d0ee7d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:40.232444 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7e73966a-ac7d-4012-bfba-26f737d0ee7d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:40.331156 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6dc8f2fe-a657-45be-9ae2-9caa65d4effe tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:40.332571 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-6dc8f2fe-a657-45be-9ae2-9caa65d4effe tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:40.349581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6dc8f2fe-a657-45be-9ae2-9caa65d4effe tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:40.350606 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6dc8f2fe-a657-45be-9ae2-9caa65d4effe tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:40.351998 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6dc8f2fe-a657-45be-9ae2-9caa65d4effe tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:40.352553 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6dc8f2fe-a657-45be-9ae2-9caa65d4effe tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:40.419520 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-7e73966a-ac7d-4012-bfba-26f737d0ee7d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:40.429177 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7e73966a-ac7d-4012-bfba-26f737d0ee7d tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1756 microversion: 2.1 time: 0.209308 Jun 20 14:55:40.439164 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 208/427] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:40 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1756 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:40.522449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6dc8f2fe-a657-45be-9ae2-9caa65d4effe tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:40.530851 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6dc8f2fe-a657-45be-9ae2-9caa65d4effe tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1682 microversion: 2.1 time: 0.205645 Jun 20 14:55:40.540620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 220/428] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:40 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1682 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:41.221483 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1c716e10-d6e4-4339-830b-e4b340a6762c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:41.222076 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1c716e10-d6e4-4339-830b-e4b340a6762c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:41.228491 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1c716e10-d6e4-4339-830b-e4b340a6762c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:41.229162 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1c716e10-d6e4-4339-830b-e4b340a6762c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:41.230078 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1c716e10-d6e4-4339-830b-e4b340a6762c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:41.230614 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1c716e10-d6e4-4339-830b-e4b340a6762c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:41.447492 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-255f72d0-ee15-40f8-ac11-4de5286d38e2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:41.448342 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-255f72d0-ee15-40f8-ac11-4de5286d38e2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:41.456758 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-255f72d0-ee15-40f8-ac11-4de5286d38e2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:41.457220 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-255f72d0-ee15-40f8-ac11-4de5286d38e2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:41.458004 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-255f72d0-ee15-40f8-ac11-4de5286d38e2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:41.458442 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-255f72d0-ee15-40f8-ac11-4de5286d38e2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:41.636913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-255f72d0-ee15-40f8-ac11-4de5286d38e2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:41.645984 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-255f72d0-ee15-40f8-ac11-4de5286d38e2 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1756 microversion: 2.1 time: 0.203210 Jun 20 14:55:41.646583 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 221/429] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:41 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1756 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:41.651074 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ca6e2722-5356-4c91-a3ad-1d81254da460 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:41.652084 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ca6e2722-5356-4c91-a3ad-1d81254da460 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:41.659041 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ca6e2722-5356-4c91-a3ad-1d81254da460 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:41.659490 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ca6e2722-5356-4c91-a3ad-1d81254da460 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:41.660503 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ca6e2722-5356-4c91-a3ad-1d81254da460 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:41.660976 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ca6e2722-5356-4c91-a3ad-1d81254da460 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:41.729613 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ca6e2722-5356-4c91-a3ad-1d81254da460 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:41.737556 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ca6e2722-5356-4c91-a3ad-1d81254da460 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1614 microversion: 2.1 time: 0.089951 Jun 20 14:55:41.738139 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 222/430] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:41 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:41.812080 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1c716e10-d6e4-4339-830b-e4b340a6762c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:41.822334 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1c716e10-d6e4-4339-830b-e4b340a6762c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:41.824381 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1c716e10-d6e4-4339-830b-e4b340a6762c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:41.825623 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1c716e10-d6e4-4339-830b-e4b340a6762c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1723 microversion: 2.20 time: 0.608119 Jun 20 14:55:41.826797 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 209/431] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:41 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1723 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:42.111849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-d19eb3a7-09ce-44d7-9db7-036e62ce9a7a req-32584e4f-4015-4b42-991d-9d722dc52c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbec336a-d2a1-4417-ae64-bf09da7cceda", "name": "network-vif-deleted", "tag": "e9da401c-2faa-4ed5-ba47-172b7b568c5a"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:42.131049 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-d19eb3a7-09ce-44d7-9db7-036e62ce9a7a req-32584e4f-4015-4b42-991d-9d722dc52c53 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:42.132474 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-d19eb3a7-09ce-44d7-9db7-036e62ce9a7a req-32584e4f-4015-4b42-991d-9d722dc52c53 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:42.145207 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-d19eb3a7-09ce-44d7-9db7-036e62ce9a7a req-32584e4f-4015-4b42-991d-9d722dc52c53 service nova] Creating event network-vif-deleted:e9da401c-2faa-4ed5-ba47-172b7b568c5a for instance cbec336a-d2a1-4417-ae64-bf09da7cceda on hv-cinder-83697 Jun 20 14:55:42.152016 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-d19eb3a7-09ce-44d7-9db7-036e62ce9a7a req-32584e4f-4015-4b42-991d-9d722dc52c53 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055240 Jun 20 14:55:42.152627 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 223/432] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:55:42.665870 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-fc69c02a-d72d-4c0c-9a59-cee25b4e4c19 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:42.666430 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-fc69c02a-d72d-4c0c-9a59-cee25b4e4c19 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:42.673957 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fc69c02a-d72d-4c0c-9a59-cee25b4e4c19 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:42.674401 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fc69c02a-d72d-4c0c-9a59-cee25b4e4c19 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:42.675135 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fc69c02a-d72d-4c0c-9a59-cee25b4e4c19 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:42.675756 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fc69c02a-d72d-4c0c-9a59-cee25b4e4c19 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:42.756553 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-47b7a9a5-c71e-4239-95aa-4d67f959a1e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:42.758045 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-47b7a9a5-c71e-4239-95aa-4d67f959a1e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:42.771227 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-47b7a9a5-c71e-4239-95aa-4d67f959a1e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:42.773333 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-47b7a9a5-c71e-4239-95aa-4d67f959a1e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:42.775246 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-47b7a9a5-c71e-4239-95aa-4d67f959a1e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:42.775828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-47b7a9a5-c71e-4239-95aa-4d67f959a1e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:42.814882 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-47b7a9a5-c71e-4239-95aa-4d67f959a1e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:42.815825 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-47b7a9a5-c71e-4239-95aa-4d67f959a1e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:42.816523 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.objects.instance [None req-47b7a9a5-c71e-4239-95aa-4d67f959a1e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lazy-loading 'fault' on Instance uuid cbec336a-d2a1-4417-ae64-bf09da7cceda {{(pid=123979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:55:42.847413 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-fc69c02a-d72d-4c0c-9a59-cee25b4e4c19 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:42.858136 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-fc69c02a-d72d-4c0c-9a59-cee25b4e4c19 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1756 microversion: 2.1 time: 0.195901 Jun 20 14:55:42.863210 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-47b7a9a5-c71e-4239-95aa-4d67f959a1e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:42.867966 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 210/433] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:42 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:42.871252 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-47b7a9a5-c71e-4239-95aa-4d67f959a1e4 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1331 microversion: 2.1 time: 0.120417 Jun 20 14:55:42.872163 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 224/434] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:42 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:55:42.875204 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-889d6d33-0b61-48b9-98ba-291aada74c7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:42.876046 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-889d6d33-0b61-48b9-98ba-291aada74c7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:42.884607 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-889d6d33-0b61-48b9-98ba-291aada74c7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:42.885086 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-889d6d33-0b61-48b9-98ba-291aada74c7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:42.885875 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-889d6d33-0b61-48b9-98ba-291aada74c7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:42.886306 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-889d6d33-0b61-48b9-98ba-291aada74c7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:43.031853 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-889d6d33-0b61-48b9-98ba-291aada74c7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:43.039933 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-889d6d33-0b61-48b9-98ba-291aada74c7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:43.041483 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-889d6d33-0b61-48b9-98ba-291aada74c7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:43.042642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-889d6d33-0b61-48b9-98ba-291aada74c7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1723 microversion: 2.20 time: 0.173407 Jun 20 14:55:43.043385 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 211/435] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:42 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:43.875919 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-5961c66d-f58c-4838-bd44-9018afc03c6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:43.876815 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-5961c66d-f58c-4838-bd44-9018afc03c6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:43.886179 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5961c66d-f58c-4838-bd44-9018afc03c6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:43.886935 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5961c66d-f58c-4838-bd44-9018afc03c6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:43.887712 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5961c66d-f58c-4838-bd44-9018afc03c6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:43.888463 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5961c66d-f58c-4838-bd44-9018afc03c6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:43.890608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-9ef584c2-84ca-4898-b403-914baeb523e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:43.891435 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-9ef584c2-84ca-4898-b403-914baeb523e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:43.898188 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9ef584c2-84ca-4898-b403-914baeb523e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:43.898601 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9ef584c2-84ca-4898-b403-914baeb523e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:43.899406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9ef584c2-84ca-4898-b403-914baeb523e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:43.899834 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9ef584c2-84ca-4898-b403-914baeb523e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:43.933899 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9ef584c2-84ca-4898-b403-914baeb523e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:43.934339 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9ef584c2-84ca-4898-b403-914baeb523e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:43.934823 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-9ef584c2-84ca-4898-b403-914baeb523e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lazy-loading 'fault' on Instance uuid cbec336a-d2a1-4417-ae64-bf09da7cceda {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:55:43.989324 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-9ef584c2-84ca-4898-b403-914baeb523e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:43.998940 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-9ef584c2-84ca-4898-b403-914baeb523e9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 200 len: 1331 microversion: 2.1 time: 0.112885 Jun 20 14:55:43.999811 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 212/436] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:43 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:44.053249 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-5961c66d-f58c-4838-bd44-9018afc03c6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:44.061015 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-89dd458b-14c7-49e0-a83a-aac4d1639e88 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:44.061736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-89dd458b-14c7-49e0-a83a-aac4d1639e88 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:44.062734 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-5961c66d-f58c-4838-bd44-9018afc03c6b tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1756 microversion: 2.1 time: 0.191536 Jun 20 14:55:44.063282 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 225/437] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:43 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:44.068411 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-89dd458b-14c7-49e0-a83a-aac4d1639e88 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:44.068913 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-89dd458b-14c7-49e0-a83a-aac4d1639e88 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:44.069696 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-89dd458b-14c7-49e0-a83a-aac4d1639e88 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:44.070107 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-89dd458b-14c7-49e0-a83a-aac4d1639e88 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:44.218250 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-89dd458b-14c7-49e0-a83a-aac4d1639e88 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:44.232637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-89dd458b-14c7-49e0-a83a-aac4d1639e88 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:44.237255 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-89dd458b-14c7-49e0-a83a-aac4d1639e88 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:44.238516 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-89dd458b-14c7-49e0-a83a-aac4d1639e88 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1723 microversion: 2.20 time: 0.181631 Jun 20 14:55:44.239086 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 213/438] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:44 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:45.019556 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-067dcd3e-2fdc-4e8e-a202-e9e9f658ee91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:45.020806 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-067dcd3e-2fdc-4e8e-a202-e9e9f658ee91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:45.031216 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-067dcd3e-2fdc-4e8e-a202-e9e9f658ee91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:45.032342 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-067dcd3e-2fdc-4e8e-a202-e9e9f658ee91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:45.033151 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-067dcd3e-2fdc-4e8e-a202-e9e9f658ee91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:45.033581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-067dcd3e-2fdc-4e8e-a202-e9e9f658ee91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:45.048041 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-067dcd3e-2fdc-4e8e-a202-e9e9f658ee91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] HTTP exception thrown: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-067dcd3e-2fdc-4e8e-a202-e9e9f658ee91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Request method failure captured: Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda HTTP/1.1 Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImbz0WxD1k9ycjcFtONQioapmstd9ALeY-XOY9KWzwZRC4BzRHKOJNKseVz_SOU8X1kqkeZceHCAJurCXmzp5osSOaO2_Ehpi_atwxfvtaZZDfF13_WZ-v9TPM1dlOrXp8wu-OjE4ErE1kdNfUTWsTDESJSRneLOLv_h39cbJpuqhQ Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:55:45.049717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:55:45.051168 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}] Jun 20 14:55:45.051168 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:55:45.051168 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:55:45.051168 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:55:45.051168 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:55:45.051168 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:55:45.051168 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:55:45.051168 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 87c3f39c0bed4fadbc8a556c857baf4a Jun 20 14:55:45.051168 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:55:45.051168 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:55:45.051168 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. Jun 20 14:55:45.051168 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': 'cbec336a-d2a1-4417-ae64-bf09da7cceda'} Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:55:45.051956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. Jun 20 14:55:45.053346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:55:45.054601 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-067dcd3e-2fdc-4e8e-a202-e9e9f658ee91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Returning 404 to user: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:55:45.054601 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-067dcd3e-2fdc-4e8e-a202-e9e9f658ee91 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 404 len: 111 microversion: 2.1 time: 0.038127 Jun 20 14:55:45.054601 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 226/439] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:45 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:55:45.060087 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-98788a9f-0258-42e2-b86e-3d717a4f6ab1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '.version_select at 0x7fce50ceee50>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:45.079680 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-146ac51b-1a09-460a-b9d1-c75cb7b0b638 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:45.080280 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-146ac51b-1a09-460a-b9d1-c75cb7b0b638 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:45.081189 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-98788a9f-0258-42e2-b86e-3d717a4f6ab1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832732822" status: 202 len: 0 microversion: 2.1 time: 0.024899 Jun 20 14:55:45.081759 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 214/440] 10.222.0.23 () {58 vars in 1220 bytes} [Mon Jun 20 14:55:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832732822 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 14:55:45.095658 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-146ac51b-1a09-460a-b9d1-c75cb7b0b638 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:45.096110 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-146ac51b-1a09-460a-b9d1-c75cb7b0b638 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:45.101783 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-146ac51b-1a09-460a-b9d1-c75cb7b0b638 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:45.102427 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-146ac51b-1a09-460a-b9d1-c75cb7b0b638 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:45.257183 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-803b535c-51fc-42c3-a004-11f144746c09 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:45.257957 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-803b535c-51fc-42c3-a004-11f144746c09 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:45.265142 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-803b535c-51fc-42c3-a004-11f144746c09 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:45.265590 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-803b535c-51fc-42c3-a004-11f144746c09 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:45.266360 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-803b535c-51fc-42c3-a004-11f144746c09 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:45.266787 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-803b535c-51fc-42c3-a004-11f144746c09 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:45.309334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-146ac51b-1a09-460a-b9d1-c75cb7b0b638 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:45.323275 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-146ac51b-1a09-460a-b9d1-c75cb7b0b638 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1759 microversion: 2.1 time: 0.247132 Jun 20 14:55:45.331024 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 227/441] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:45 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1759 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:45.428506 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-803b535c-51fc-42c3-a004-11f144746c09 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:45.432342 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:45.439291 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-803b535c-51fc-42c3-a004-11f144746c09 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:45.441155 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-803b535c-51fc-42c3-a004-11f144746c09 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:45.442536 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-803b535c-51fc-42c3-a004-11f144746c09 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1666 microversion: 2.20 time: 0.189490 Jun 20 14:55:45.444183 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 215/442] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:45 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1666 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:45.462182 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e9c2c69e-5031-4030-b94e-7c2a4645c37c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6084040-1e6a-48d8-98c0-0226b875cabb"}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:45.463624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e9c2c69e-5031-4030-b94e-7c2a4645c37c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:45.470537 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e9c2c69e-5031-4030-b94e-7c2a4645c37c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:45.471189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e9c2c69e-5031-4030-b94e-7c2a4645c37c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:45.472072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e9c2c69e-5031-4030-b94e-7c2a4645c37c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:45.472561 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e9c2c69e-5031-4030-b94e-7c2a4645c37c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:45.476743 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=100 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:45.507140 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-d817d859-0a7d-411f-8b8a-531b904f12c5 req-c00add4e-8d67-494c-bfee-399c344c354f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916159e1-4580-4bb4-a78f-857e9e15c61b", "name": "network-vif-unplugged", "status": "completed", "tag": "4003555e-bf92-479e-b2dd-be6fe4500b56"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:45.523072 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-d817d859-0a7d-411f-8b8a-531b904f12c5 req-c00add4e-8d67-494c-bfee-399c344c354f service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:45.523509 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-d817d859-0a7d-411f-8b8a-531b904f12c5 req-c00add4e-8d67-494c-bfee-399c344c354f service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:45.538315 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.compute.server_external_events [req-d817d859-0a7d-411f-8b8a-531b904f12c5 req-c00add4e-8d67-494c-bfee-399c344c354f service nova] Unable to find a host for instance 916159e1-4580-4bb4-a78f-857e9e15c61b. Dropping event network-vif-unplugged {{(pid=123978) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 20 14:55:45.539200 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-d817d859-0a7d-411f-8b8a-531b904f12c5 req-c00add4e-8d67-494c-bfee-399c344c354f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038951 Jun 20 14:55:45.539781 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 216/443] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 20 14:55:45.784604 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e9c2c69e-5031-4030-b94e-7c2a4645c37c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "POST /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.326412 Jun 20 14:55:45.785414 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 228/444] 10.222.0.23 () {62 vars in 1363 bytes} [Mon Jun 20 14:55:45 2022] POST /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments => generated 188 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:55:45.908473 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c3f971a1-1c50-4838-9f36-c38e6334e686 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:45.909202 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-c3f971a1-1c50-4838-9f36-c38e6334e686 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:45.915436 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c3f971a1-1c50-4838-9f36-c38e6334e686 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:45.915882 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c3f971a1-1c50-4838-9f36-c38e6334e686 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:45.916650 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c3f971a1-1c50-4838-9f36-c38e6334e686 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:45.917093 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c3f971a1-1c50-4838-9f36-c38e6334e686 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:45.927023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e86bdb48-d4e4-4258-9d63-a940a3b987b6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:45.927582 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e86bdb48-d4e4-4258-9d63-a940a3b987b6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:45.934337 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e86bdb48-d4e4-4258-9d63-a940a3b987b6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:45.934862 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e86bdb48-d4e4-4258-9d63-a940a3b987b6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:45.935654 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e86bdb48-d4e4-4258-9d63-a940a3b987b6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:45.936069 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e86bdb48-d4e4-4258-9d63-a940a3b987b6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:46.038185 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e86bdb48-d4e4-4258-9d63-a940a3b987b6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "POST /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/action" status: 202 len: 0 microversion: 2.20 time: 0.115068 Jun 20 14:55:46.039105 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 229/445] 10.222.0.23 () {62 vars in 1318 bytes} [Mon Jun 20 14:55:45 2022] POST /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:55:46.043027 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-c3f971a1-1c50-4838-9f36-c38e6334e686 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lazy-loading 'services' on Instance uuid 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:55:46.047060 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d30f4257-f594-4ef7-831d-28250ce42cd4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:46.047770 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d30f4257-f594-4ef7-831d-28250ce42cd4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:46.055497 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d30f4257-f594-4ef7-831d-28250ce42cd4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:46.056020 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d30f4257-f594-4ef7-831d-28250ce42cd4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:46.057031 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d30f4257-f594-4ef7-831d-28250ce42cd4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:46.057531 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d30f4257-f594-4ef7-831d-28250ce42cd4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:46.173282 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-c3f971a1-1c50-4838-9f36-c38e6334e686 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e/os-volume_attachments/b495f8d7-3575-47ec-934c-da3c81f55bf7" status: 202 len: 0 microversion: 2.1 time: 0.267499 Jun 20 14:55:46.174607 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 217/446] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 14:55:45 2022] DELETE /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e/os-volume_attachments/b495f8d7-3575-47ec-934c-da3c81f55bf7 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 14:55:46.185239 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-376efecc-3b9a-4855-a678-78cac9fcfbac tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:46.186320 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-376efecc-3b9a-4855-a678-78cac9fcfbac tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:46.195163 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-376efecc-3b9a-4855-a678-78cac9fcfbac tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:46.196750 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-376efecc-3b9a-4855-a678-78cac9fcfbac tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:46.197620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-376efecc-3b9a-4855-a678-78cac9fcfbac tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:46.198048 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-376efecc-3b9a-4855-a678-78cac9fcfbac tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:46.200615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d30f4257-f594-4ef7-831d-28250ce42cd4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:46.212033 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d30f4257-f594-4ef7-831d-28250ce42cd4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:46.217583 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d30f4257-f594-4ef7-831d-28250ce42cd4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:46.218899 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d30f4257-f594-4ef7-831d-28250ce42cd4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1752 microversion: 2.20 time: 0.175925 Jun 20 14:55:46.219550 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 230/447] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:46 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:46.233556 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-376efecc-3b9a-4855-a678-78cac9fcfbac tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054256 Jun 20 14:55:46.235070 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 218/448] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 14:55:46 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 14:55:46.446975 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-4f3a931f-00b7-4e4c-bc35-ab85cea8810c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:46.448193 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-4f3a931f-00b7-4e4c-bc35-ab85cea8810c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:46.454721 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4f3a931f-00b7-4e4c-bc35-ab85cea8810c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:46.455205 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4f3a931f-00b7-4e4c-bc35-ab85cea8810c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:46.456014 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4f3a931f-00b7-4e4c-bc35-ab85cea8810c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:46.456451 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4f3a931f-00b7-4e4c-bc35-ab85cea8810c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:46.479517 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.objects.instance [None req-4f3a931f-00b7-4e4c-bc35-ab85cea8810c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lazy-loading 'flavor' on Instance uuid 68161747-6331-4819-a01b-24d3d5e80563 {{(pid=123979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:55:46.617841 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-4f3a931f-00b7-4e4c-bc35-ab85cea8810c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "POST /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/action" status: 200 len: 32 microversion: 2.1 time: 0.175024 Jun 20 14:55:46.618515 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 231/449] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 14:55:46 2022] POST /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 14:55:46.628383 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-4722df4e-68a4-4016-a54d-465240be0322 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:46.629575 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-4722df4e-68a4-4016-a54d-465240be0322 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:46.636986 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4722df4e-68a4-4016-a54d-465240be0322 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:46.637983 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4722df4e-68a4-4016-a54d-465240be0322 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:46.639161 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4722df4e-68a4-4016-a54d-465240be0322 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:46.639968 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4722df4e-68a4-4016-a54d-465240be0322 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:46.872078 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-4722df4e-68a4-4016-a54d-465240be0322 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:46.881356 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-4722df4e-68a4-4016-a54d-465240be0322 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1736 microversion: 2.1 time: 0.256996 Jun 20 14:55:46.881936 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 219/450] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:46 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1736 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:47.238806 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e3753066-2541-4994-b6ef-a5b19a2ed26a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:47.241125 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e3753066-2541-4994-b6ef-a5b19a2ed26a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:47.247590 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-dcb3fc8d-42a3-42a9-b143-91e06b698491 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:47.249698 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-dcb3fc8d-42a3-42a9-b143-91e06b698491 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:47.251202 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e3753066-2541-4994-b6ef-a5b19a2ed26a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:47.251657 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e3753066-2541-4994-b6ef-a5b19a2ed26a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:47.252471 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e3753066-2541-4994-b6ef-a5b19a2ed26a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:47.253069 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e3753066-2541-4994-b6ef-a5b19a2ed26a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:47.266281 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dcb3fc8d-42a3-42a9-b143-91e06b698491 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:47.266910 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dcb3fc8d-42a3-42a9-b143-91e06b698491 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:47.268924 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dcb3fc8d-42a3-42a9-b143-91e06b698491 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:47.269960 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dcb3fc8d-42a3-42a9-b143-91e06b698491 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:47.316238 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-dcb3fc8d-42a3-42a9-b143-91e06b698491 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073246 Jun 20 14:55:47.322032 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 220/451] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 14:55:47 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 14:55:47.381187 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-92d07cef-ba28-4c14-8996-815d291917b0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:47.381702 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-92d07cef-ba28-4c14-8996-815d291917b0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:47.388991 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-92d07cef-ba28-4c14-8996-815d291917b0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:47.389440 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-92d07cef-ba28-4c14-8996-815d291917b0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:47.390405 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-92d07cef-ba28-4c14-8996-815d291917b0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:47.391036 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-92d07cef-ba28-4c14-8996-815d291917b0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:47.421334 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-92d07cef-ba28-4c14-8996-815d291917b0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 14:55:47.431975 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e3753066-2541-4994-b6ef-a5b19a2ed26a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:47.456185 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e3753066-2541-4994-b6ef-a5b19a2ed26a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:47.460745 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e3753066-2541-4994-b6ef-a5b19a2ed26a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:47.462131 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e3753066-2541-4994-b6ef-a5b19a2ed26a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1752 microversion: 2.20 time: 0.228292 Jun 20 14:55:47.464021 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 232/452] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:47 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1752 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:47.511774 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-92d07cef-ba28-4c14-8996-815d291917b0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 204 len: 0 microversion: 2.1 time: 0.134690 Jun 20 14:55:47.512413 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 221/453] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:55:47 2022] DELETE /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:55:47.521276 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-efdf7d6c-f169-4e10-ae4b-5c12938c5bd9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:47.521886 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-efdf7d6c-f169-4e10-ae4b-5c12938c5bd9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:47.528116 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efdf7d6c-f169-4e10-ae4b-5c12938c5bd9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:47.528657 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efdf7d6c-f169-4e10-ae4b-5c12938c5bd9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:47.529633 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efdf7d6c-f169-4e10-ae4b-5c12938c5bd9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:47.530058 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efdf7d6c-f169-4e10-ae4b-5c12938c5bd9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:47.664895 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-efdf7d6c-f169-4e10-ae4b-5c12938c5bd9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:47.673422 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-efdf7d6c-f169-4e10-ae4b-5c12938c5bd9 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1678 microversion: 2.1 time: 0.156050 Jun 20 14:55:47.674043 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 233/454] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:47 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:47.904260 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-9347a624-b6af-40f3-b11a-cdba4f356a51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:47.905099 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-9347a624-b6af-40f3-b11a-cdba4f356a51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:47.911867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9347a624-b6af-40f3-b11a-cdba4f356a51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:47.912316 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9347a624-b6af-40f3-b11a-cdba4f356a51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:47.913118 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9347a624-b6af-40f3-b11a-cdba4f356a51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:47.913549 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9347a624-b6af-40f3-b11a-cdba4f356a51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:48.056350 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-9347a624-b6af-40f3-b11a-cdba4f356a51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:48.065099 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-9347a624-b6af-40f3-b11a-cdba4f356a51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1736 microversion: 2.1 time: 0.167916 Jun 20 14:55:48.065670 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 222/455] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:47 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:48.484068 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9ee848bf-b6f9-4783-b041-65f6926c5be8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:48.484755 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9ee848bf-b6f9-4783-b041-65f6926c5be8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:48.492417 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9ee848bf-b6f9-4783-b041-65f6926c5be8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:48.492961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9ee848bf-b6f9-4783-b041-65f6926c5be8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:48.493799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9ee848bf-b6f9-4783-b041-65f6926c5be8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:48.494274 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9ee848bf-b6f9-4783-b041-65f6926c5be8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:48.626969 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9ee848bf-b6f9-4783-b041-65f6926c5be8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:48.635898 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9ee848bf-b6f9-4783-b041-65f6926c5be8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:48.637431 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9ee848bf-b6f9-4783-b041-65f6926c5be8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:48.638700 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9ee848bf-b6f9-4783-b041-65f6926c5be8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1754 microversion: 2.20 time: 0.160111 Jun 20 14:55:48.639261 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 234/456] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:48 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:48.694742 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-a548982a-c30b-4b04-b465-f477c25f4260 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:48.695747 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-a548982a-c30b-4b04-b465-f477c25f4260 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:48.706972 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a548982a-c30b-4b04-b465-f477c25f4260 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:48.707702 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a548982a-c30b-4b04-b465-f477c25f4260 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:48.708996 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a548982a-c30b-4b04-b465-f477c25f4260 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:48.709705 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a548982a-c30b-4b04-b465-f477c25f4260 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:48.850376 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-a548982a-c30b-4b04-b465-f477c25f4260 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:48.858364 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-a548982a-c30b-4b04-b465-f477c25f4260 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1678 microversion: 2.1 time: 0.169865 Jun 20 14:55:48.859022 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 223/457] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:48 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:49.082462 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0f629b5c-07b7-4c74-8f8d-2ee0bc35b374 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:49.083069 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-0f629b5c-07b7-4c74-8f8d-2ee0bc35b374 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:49.089497 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0f629b5c-07b7-4c74-8f8d-2ee0bc35b374 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:49.089930 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0f629b5c-07b7-4c74-8f8d-2ee0bc35b374 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:49.090688 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0f629b5c-07b7-4c74-8f8d-2ee0bc35b374 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:49.091244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0f629b5c-07b7-4c74-8f8d-2ee0bc35b374 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:49.233429 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0f629b5c-07b7-4c74-8f8d-2ee0bc35b374 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:49.242369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0f629b5c-07b7-4c74-8f8d-2ee0bc35b374 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1736 microversion: 2.1 time: 0.163691 Jun 20 14:55:49.242939 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 235/458] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:49 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:49.656329 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-9a2fed81-4123-4923-a6fd-db30a9f99f9b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:49.656858 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-9a2fed81-4123-4923-a6fd-db30a9f99f9b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:49.663631 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9a2fed81-4123-4923-a6fd-db30a9f99f9b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:49.664043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9a2fed81-4123-4923-a6fd-db30a9f99f9b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:49.664794 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9a2fed81-4123-4923-a6fd-db30a9f99f9b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:49.665510 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9a2fed81-4123-4923-a6fd-db30a9f99f9b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:49.876306 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9c8730ee-9290-4ab6-9787-e6a5a6f8bfe7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:49.876875 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9c8730ee-9290-4ab6-9787-e6a5a6f8bfe7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:49.883632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9c8730ee-9290-4ab6-9787-e6a5a6f8bfe7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:49.884074 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9c8730ee-9290-4ab6-9787-e6a5a6f8bfe7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:49.884871 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9c8730ee-9290-4ab6-9787-e6a5a6f8bfe7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:49.885269 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9c8730ee-9290-4ab6-9787-e6a5a6f8bfe7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:49.887526 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-9a2fed81-4123-4923-a6fd-db30a9f99f9b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:49.899727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-9a2fed81-4123-4923-a6fd-db30a9f99f9b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:49.901678 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-9a2fed81-4123-4923-a6fd-db30a9f99f9b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:49.902846 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-9a2fed81-4123-4923-a6fd-db30a9f99f9b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.250862 Jun 20 14:55:49.903686 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 224/459] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:49 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:49.962790 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9c8730ee-9290-4ab6-9787-e6a5a6f8bfe7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:49.970967 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9c8730ee-9290-4ab6-9787-e6a5a6f8bfe7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1612 microversion: 2.1 time: 0.098915 Jun 20 14:55:49.971536 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 236/460] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:49 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1612 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:50.260125 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-14be6375-3b35-4074-a62d-9e01bd639e02 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:50.261001 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-14be6375-3b35-4074-a62d-9e01bd639e02 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:50.268083 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-14be6375-3b35-4074-a62d-9e01bd639e02 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:50.268847 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-14be6375-3b35-4074-a62d-9e01bd639e02 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:50.269807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-14be6375-3b35-4074-a62d-9e01bd639e02 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:50.270390 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-14be6375-3b35-4074-a62d-9e01bd639e02 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:50.547448 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-e31a35d8-1efb-4740-b530-bf275d453039 req-8e18672f-b910-4e31-b1bb-9df5fce905aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e", "name": "network-vif-deleted", "tag": "d5c181e8-9634-4dd9-9d76-478532026463"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:50.557867 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-e31a35d8-1efb-4740-b530-bf275d453039 req-8e18672f-b910-4e31-b1bb-9df5fce905aa service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:50.558423 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-e31a35d8-1efb-4740-b530-bf275d453039 req-8e18672f-b910-4e31-b1bb-9df5fce905aa service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:50.570825 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-e31a35d8-1efb-4740-b530-bf275d453039 req-8e18672f-b910-4e31-b1bb-9df5fce905aa service nova] Creating event network-vif-deleted:d5c181e8-9634-4dd9-9d76-478532026463 for instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e on hv-cinder-83697 Jun 20 14:55:50.576232 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-e31a35d8-1efb-4740-b530-bf275d453039 req-8e18672f-b910-4e31-b1bb-9df5fce905aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032596 Jun 20 14:55:50.577837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 237/461] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:55:50.665184 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-14be6375-3b35-4074-a62d-9e01bd639e02 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:50.674096 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-14be6375-3b35-4074-a62d-9e01bd639e02 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1736 microversion: 2.1 time: 0.417970 Jun 20 14:55:50.684925 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 225/462] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:50 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1736 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:50.922650 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9f498646-a987-4c74-9249-f0fed49cfa8a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:50.923542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9f498646-a987-4c74-9249-f0fed49cfa8a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:50.930238 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9f498646-a987-4c74-9249-f0fed49cfa8a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:50.930764 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9f498646-a987-4c74-9249-f0fed49cfa8a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:50.931584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9f498646-a987-4c74-9249-f0fed49cfa8a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:50.932094 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9f498646-a987-4c74-9249-f0fed49cfa8a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:50.995161 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3efd71e8-e6e2-4fa1-82f3-5618900d3d60 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:50.995782 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-3efd71e8-e6e2-4fa1-82f3-5618900d3d60 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:51.006296 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3efd71e8-e6e2-4fa1-82f3-5618900d3d60 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:51.007037 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3efd71e8-e6e2-4fa1-82f3-5618900d3d60 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:51.008087 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3efd71e8-e6e2-4fa1-82f3-5618900d3d60 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:51.008613 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3efd71e8-e6e2-4fa1-82f3-5618900d3d60 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:51.043379 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3efd71e8-e6e2-4fa1-82f3-5618900d3d60 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:51.043733 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3efd71e8-e6e2-4fa1-82f3-5618900d3d60 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:51.044339 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-3efd71e8-e6e2-4fa1-82f3-5618900d3d60 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lazy-loading 'fault' on Instance uuid 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:55:51.107129 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3efd71e8-e6e2-4fa1-82f3-5618900d3d60 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:51.117357 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-3efd71e8-e6e2-4fa1-82f3-5618900d3d60 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 200 len: 1330 microversion: 2.1 time: 0.132830 Jun 20 14:55:51.119088 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 226/463] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:50 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 1330 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:51.121138 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9f498646-a987-4c74-9249-f0fed49cfa8a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:51.130464 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9f498646-a987-4c74-9249-f0fed49cfa8a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:51.131939 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9f498646-a987-4c74-9249-f0fed49cfa8a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:51.133133 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9f498646-a987-4c74-9249-f0fed49cfa8a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.216062 Jun 20 14:55:51.133703 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 238/464] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:50 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:51.692992 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-08e8f20d-94af-47eb-a481-dd81cf394981 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:51.693893 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-08e8f20d-94af-47eb-a481-dd81cf394981 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:51.700491 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-08e8f20d-94af-47eb-a481-dd81cf394981 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:51.701268 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-08e8f20d-94af-47eb-a481-dd81cf394981 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:51.702286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-08e8f20d-94af-47eb-a481-dd81cf394981 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:51.702923 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-08e8f20d-94af-47eb-a481-dd81cf394981 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:51.871865 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-08e8f20d-94af-47eb-a481-dd81cf394981 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:51.881019 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-08e8f20d-94af-47eb-a481-dd81cf394981 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1736 microversion: 2.1 time: 0.192340 Jun 20 14:55:51.881872 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 227/465] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:51 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:52.135373 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-de2a311e-c727-468f-847d-79a34017069a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:52.136067 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-de2a311e-c727-468f-847d-79a34017069a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:52.143681 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-de2a311e-c727-468f-847d-79a34017069a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:52.144124 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-de2a311e-c727-468f-847d-79a34017069a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:52.144992 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-de2a311e-c727-468f-847d-79a34017069a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:52.145592 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-de2a311e-c727-468f-847d-79a34017069a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:52.150922 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-415817b2-88c4-4106-b85f-c0ec1472e861 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:52.151500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-415817b2-88c4-4106-b85f-c0ec1472e861 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:52.159208 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-415817b2-88c4-4106-b85f-c0ec1472e861 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:52.159742 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-415817b2-88c4-4106-b85f-c0ec1472e861 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:52.160638 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-415817b2-88c4-4106-b85f-c0ec1472e861 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:52.161180 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-415817b2-88c4-4106-b85f-c0ec1472e861 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:52.162299 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-de2a311e-c727-468f-847d-79a34017069a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] HTTP exception thrown: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-de2a311e-c727-468f-847d-79a34017069a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Request method failure captured: Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e HTTP/1.1 Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImbz0WxD1k9ycjcFtONQioapmstd9ALeY-XOY9KWzwZRC4BzRHKOJNKseVz_SOU8X1kqkeZceHCAJurCXmzp5osSOaO2_Ehpi_atwxfvtaZZDfF13_WZ-v9TPM1dlOrXp8wu-OjE4ErE1kdNfUTWsTDESJSRneLOLv_h39cbJpuqhQ Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:55:52.163937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:55:52.165302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}] Jun 20 14:55:52.165302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:55:52.165302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:55:52.165302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:55:52.165302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:55:52.165302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:55:52.165302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:55:52.165302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 87c3f39c0bed4fadbc8a556c857baf4a Jun 20 14:55:52.165302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:55:52.165302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:55:52.165302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. Jun 20 14:55:52.165302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e'} Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:55:52.165978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. Jun 20 14:55:52.167086 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:55:52.170537 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-de2a311e-c727-468f-847d-79a34017069a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Returning 404 to user: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:55:52.171904 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-de2a311e-c727-468f-847d-79a34017069a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 404 len: 111 microversion: 2.1 time: 0.040471 Jun 20 14:55:52.176807 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 239/466] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:52 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:55:52.181842 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-93036991-5bc6-46bb-8038-d35cba6982eb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '.version_select at 0x7fce50ad7a60>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:52.213873 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-93036991-5bc6-46bb-8038-d35cba6982eb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-694137795" status: 202 len: 0 microversion: 2.1 time: 0.035608 Jun 20 14:55:52.214472 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 240/467] 10.222.0.23 () {58 vars in 1217 bytes} [Mon Jun 20 14:55:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-694137795 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 14:55:52.351704 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-415817b2-88c4-4106-b85f-c0ec1472e861 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:52.362271 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-415817b2-88c4-4106-b85f-c0ec1472e861 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:52.364017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-415817b2-88c4-4106-b85f-c0ec1472e861 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:52.365652 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-415817b2-88c4-4106-b85f-c0ec1472e861 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.218583 Jun 20 14:55:52.366366 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 228/468] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:52 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:55:52.897855 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-f15b77df-6de9-4049-a6bc-a7de642430f7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:52.898658 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-f15b77df-6de9-4049-a6bc-a7de642430f7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:52.906421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f15b77df-6de9-4049-a6bc-a7de642430f7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:52.906868 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f15b77df-6de9-4049-a6bc-a7de642430f7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:52.907639 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f15b77df-6de9-4049-a6bc-a7de642430f7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:52.908069 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f15b77df-6de9-4049-a6bc-a7de642430f7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:52.936476 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:53.053081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b63af255-0633-488a-ae71-4174864b4933 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Action: 'create', calling method: .version_select at 0x7fce50ab3550>, body: {"keypair": {"name": "tempest-keypair-922701947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7UoRqWlSvsif1M5qfjL0ccu5XMUSty4POSHNslpDwnnswM+e2KUVEENWpHQmyBpoEqu+f4CRvUgIQmIORNnGGqoZ8ONeCXVfxXqyjzrhBB3hWcr5DfB4Za+sAzCKaaQQ=="}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:53.069086 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-b63af255-0633-488a-ae71-4174864b4933 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'key_pairs'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:55:53.073410 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-b63af255-0633-488a-ae71-4174864b4933 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for user 87c3f39c0bed4fadbc8a556c857baf4a and project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'key_pairs'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:55:53.093021 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-f15b77df-6de9-4049-a6bc-a7de642430f7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:53.101786 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-f15b77df-6de9-4049-a6bc-a7de642430f7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1736 microversion: 2.1 time: 0.207788 Jun 20 14:55:53.102349 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b63af255-0633-488a-ae71-4174864b4933 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055145 Jun 20 14:55:53.112098 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 229/469] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 14:55:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:55:53.113681 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 241/470] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:52 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:53.386399 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-fc2f0962-ada9-4361-b9a1-848cc15249a9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:53.393734 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-fc2f0962-ada9-4361-b9a1-848cc15249a9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:53.402800 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fc2f0962-ada9-4361-b9a1-848cc15249a9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:53.403392 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fc2f0962-ada9-4361-b9a1-848cc15249a9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:53.404172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fc2f0962-ada9-4361-b9a1-848cc15249a9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:53.404707 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fc2f0962-ada9-4361-b9a1-848cc15249a9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:53.653931 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-fc2f0962-ada9-4361-b9a1-848cc15249a9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:53.664312 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-fc2f0962-ada9-4361-b9a1-848cc15249a9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:53.665993 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-fc2f0962-ada9-4361-b9a1-848cc15249a9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:53.667156 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-fc2f0962-ada9-4361-b9a1-848cc15249a9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.285883 Jun 20 14:55:53.667718 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 230/471] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:53 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:54.121036 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-bde34d9f-0b99-4f14-b333-b7f8728685fe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:54.121717 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-bde34d9f-0b99-4f14-b333-b7f8728685fe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:54.127939 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bde34d9f-0b99-4f14-b333-b7f8728685fe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:54.128725 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bde34d9f-0b99-4f14-b333-b7f8728685fe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:54.129524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bde34d9f-0b99-4f14-b333-b7f8728685fe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:54.129948 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bde34d9f-0b99-4f14-b333-b7f8728685fe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:54.360523 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-bde34d9f-0b99-4f14-b333-b7f8728685fe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:54.370316 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-bde34d9f-0b99-4f14-b333-b7f8728685fe tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1736 microversion: 2.1 time: 0.253750 Jun 20 14:55:54.371570 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 242/472] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:54 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1736 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:55:54.691020 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2825176b-76b5-4416-a40e-50b6acc1e152 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:54.692162 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2825176b-76b5-4416-a40e-50b6acc1e152 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:54.710574 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2825176b-76b5-4416-a40e-50b6acc1e152 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:54.711215 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2825176b-76b5-4416-a40e-50b6acc1e152 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:54.712007 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2825176b-76b5-4416-a40e-50b6acc1e152 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:54.712435 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2825176b-76b5-4416-a40e-50b6acc1e152 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:54.739931 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:54.805870 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1422951800", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2b22871-0b88-408a-81b6-567b6c78e97d"}], "security_groups": [{"name": "tempest-securitygroup--446026145"}], "key_name": "tempest-keypair-922701947", "user_data": "}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:55:54.928405 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2825176b-76b5-4416-a40e-50b6acc1e152 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:54.936169 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.network.neutron [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] validate_networks() for [('b2b22871-0b88-408a-81b6-567b6c78e97d', None, None, None, None, None)] {{(pid=123979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:55:54.938603 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2825176b-76b5-4416-a40e-50b6acc1e152 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:54.941180 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2825176b-76b5-4416-a40e-50b6acc1e152 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:54.942535 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2825176b-76b5-4416-a40e-50b6acc1e152 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.261155 Jun 20 14:55:54.943442 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 231/473] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:54 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:55.341993 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Flavor limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:55:55.342509 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Image limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:55:55.342861 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Flavor pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:55:55.343263 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Image pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:55:55.343668 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:55:55.352860 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:55.353456 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:55.354531 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:55.354989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:55.381930 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:55:55.386903 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for user 87c3f39c0bed4fadbc8a556c857baf4a and project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:55:55.390996 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-a4520472-4a9f-43c1-8755-e8fee86d4727 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:55.391684 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-a4520472-4a9f-43c1-8755-e8fee86d4727 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:55.398046 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a4520472-4a9f-43c1-8755-e8fee86d4727 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:55.398563 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Going to run 1 instances... {{(pid=123979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:55:55.398706 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a4520472-4a9f-43c1-8755-e8fee86d4727 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:55.399472 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a4520472-4a9f-43c1-8755-e8fee86d4727 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:55.403746 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a4520472-4a9f-43c1-8755-e8fee86d4727 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:55.403930 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:55:55.454712 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-03f5a493-60d7-4c04-9a1e-67f4e7ba9dca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.653050 Jun 20 14:55:55.456829 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 243/474] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 14:55:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 14:55:55.475041 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-79cc2973-2838-434a-8e8a-5970add24008 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:55.475794 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-79cc2973-2838-434a-8e8a-5970add24008 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:55.576567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-79cc2973-2838-434a-8e8a-5970add24008 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:55.584638 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-a4520472-4a9f-43c1-8755-e8fee86d4727 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:55.585195 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-79cc2973-2838-434a-8e8a-5970add24008 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1241 microversion: 2.1 time: 0.117655 Jun 20 14:55:55.585867 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 244/475] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:55 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1241 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:55.599033 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-a4520472-4a9f-43c1-8755-e8fee86d4727 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1736 microversion: 2.1 time: 0.212442 Jun 20 14:55:55.599536 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 232/476] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:55 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:55.963107 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6f383ec5-8fb4-49c5-a9f0-af2616cf2d0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:55.963881 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-6f383ec5-8fb4-49c5-a9f0-af2616cf2d0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:55.972312 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6f383ec5-8fb4-49c5-a9f0-af2616cf2d0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:55.972851 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6f383ec5-8fb4-49c5-a9f0-af2616cf2d0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:55.973632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6f383ec5-8fb4-49c5-a9f0-af2616cf2d0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:55.974070 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6f383ec5-8fb4-49c5-a9f0-af2616cf2d0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:56.115262 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6f383ec5-8fb4-49c5-a9f0-af2616cf2d0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:56.124203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6f383ec5-8fb4-49c5-a9f0-af2616cf2d0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:56.125869 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6f383ec5-8fb4-49c5-a9f0-af2616cf2d0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:56.127192 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6f383ec5-8fb4-49c5-a9f0-af2616cf2d0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.168439 Jun 20 14:55:56.127915 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 245/477] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:55 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:56.603750 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7234dc3f-1390-4bc8-bd30-dd2ce9470818 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:56.604452 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7234dc3f-1390-4bc8-bd30-dd2ce9470818 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:56.612775 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7234dc3f-1390-4bc8-bd30-dd2ce9470818 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:56.613285 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7234dc3f-1390-4bc8-bd30-dd2ce9470818 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:56.614036 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7234dc3f-1390-4bc8-bd30-dd2ce9470818 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:56.614502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7234dc3f-1390-4bc8-bd30-dd2ce9470818 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:56.616154 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-aba0e072-0971-4baa-84bd-dba92235c5b9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:56.617123 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-aba0e072-0971-4baa-84bd-dba92235c5b9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:56.623779 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-aba0e072-0971-4baa-84bd-dba92235c5b9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:56.624373 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-aba0e072-0971-4baa-84bd-dba92235c5b9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:56.625430 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-aba0e072-0971-4baa-84bd-dba92235c5b9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:56.625430 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-aba0e072-0971-4baa-84bd-dba92235c5b9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:56.718802 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-7234dc3f-1390-4bc8-bd30-dd2ce9470818 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:56.728681 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7234dc3f-1390-4bc8-bd30-dd2ce9470818 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1245 microversion: 2.1 time: 0.128913 Jun 20 14:55:56.729511 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 233/478] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:56 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1245 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:56.787546 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-aba0e072-0971-4baa-84bd-dba92235c5b9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:56.796016 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-aba0e072-0971-4baa-84bd-dba92235c5b9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1736 microversion: 2.1 time: 0.184413 Jun 20 14:55:56.796955 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 246/479] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:56 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:55:57.146506 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-caac8234-2206-4fb6-a864-148786497609 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:57.147078 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-caac8234-2206-4fb6-a864-148786497609 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:57.153688 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-caac8234-2206-4fb6-a864-148786497609 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:57.154596 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-caac8234-2206-4fb6-a864-148786497609 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:57.155369 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-caac8234-2206-4fb6-a864-148786497609 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:57.155792 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-caac8234-2206-4fb6-a864-148786497609 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:57.293328 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-caac8234-2206-4fb6-a864-148786497609 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:57.302699 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-caac8234-2206-4fb6-a864-148786497609 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:57.304275 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-caac8234-2206-4fb6-a864-148786497609 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:57.305800 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-caac8234-2206-4fb6-a864-148786497609 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.163227 Jun 20 14:55:57.306371 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 234/480] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:57 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:57.748005 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-f4a5c3ab-9e09-4f05-a6ac-dbbc8a2df5dc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:57.748854 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-f4a5c3ab-9e09-4f05-a6ac-dbbc8a2df5dc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:57.755540 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f4a5c3ab-9e09-4f05-a6ac-dbbc8a2df5dc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:57.759792 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f4a5c3ab-9e09-4f05-a6ac-dbbc8a2df5dc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:57.760768 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f4a5c3ab-9e09-4f05-a6ac-dbbc8a2df5dc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:57.761225 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f4a5c3ab-9e09-4f05-a6ac-dbbc8a2df5dc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:57.813633 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6580d32a-9274-40b4-a146-eb178343fbc7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:57.814333 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6580d32a-9274-40b4-a146-eb178343fbc7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:57.822505 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6580d32a-9274-40b4-a146-eb178343fbc7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:57.823043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6580d32a-9274-40b4-a146-eb178343fbc7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:57.823888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6580d32a-9274-40b4-a146-eb178343fbc7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:57.824381 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6580d32a-9274-40b4-a146-eb178343fbc7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:57.835024 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-f4a5c3ab-9e09-4f05-a6ac-dbbc8a2df5dc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:57.842945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-f4a5c3ab-9e09-4f05-a6ac-dbbc8a2df5dc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1245 microversion: 2.1 time: 0.100188 Jun 20 14:55:57.843874 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 247/481] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:57 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:57.971407 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-6580d32a-9274-40b4-a146-eb178343fbc7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:57.980683 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6580d32a-9274-40b4-a146-eb178343fbc7 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1736 microversion: 2.1 time: 0.171099 Jun 20 14:55:57.981500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 235/482] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:57 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:55:58.324418 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9ec775f9-6538-4de2-99c0-ee3e0ebde573 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:58.325052 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9ec775f9-6538-4de2-99c0-ee3e0ebde573 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:58.331394 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9ec775f9-6538-4de2-99c0-ee3e0ebde573 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:58.331823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9ec775f9-6538-4de2-99c0-ee3e0ebde573 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:58.332741 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9ec775f9-6538-4de2-99c0-ee3e0ebde573 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:58.333169 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9ec775f9-6538-4de2-99c0-ee3e0ebde573 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:58.474907 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9ec775f9-6538-4de2-99c0-ee3e0ebde573 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:58.483936 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9ec775f9-6538-4de2-99c0-ee3e0ebde573 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:58.485473 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9ec775f9-6538-4de2-99c0-ee3e0ebde573 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:58.486663 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9ec775f9-6538-4de2-99c0-ee3e0ebde573 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.166503 Jun 20 14:55:58.487419 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 248/483] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:58 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:58.863085 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-69f137a2-c8a9-4257-a422-429c55ae507e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:58.863686 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-69f137a2-c8a9-4257-a422-429c55ae507e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:58.871975 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-69f137a2-c8a9-4257-a422-429c55ae507e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:58.872504 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-69f137a2-c8a9-4257-a422-429c55ae507e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:58.873361 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-69f137a2-c8a9-4257-a422-429c55ae507e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:58.873999 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-69f137a2-c8a9-4257-a422-429c55ae507e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:58.941113 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-69f137a2-c8a9-4257-a422-429c55ae507e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:58.948833 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-69f137a2-c8a9-4257-a422-429c55ae507e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1245 microversion: 2.1 time: 0.090250 Jun 20 14:55:58.949501 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 236/484] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:58 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:58.998874 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-60c08ee8-2918-4f3c-a202-bdb57983be2d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:58.999784 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-60c08ee8-2918-4f3c-a202-bdb57983be2d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:59.007035 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-60c08ee8-2918-4f3c-a202-bdb57983be2d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:59.007607 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-60c08ee8-2918-4f3c-a202-bdb57983be2d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:59.008495 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-60c08ee8-2918-4f3c-a202-bdb57983be2d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:59.009141 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-60c08ee8-2918-4f3c-a202-bdb57983be2d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:59.145375 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-60c08ee8-2918-4f3c-a202-bdb57983be2d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:59.155884 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-60c08ee8-2918-4f3c-a202-bdb57983be2d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1736 microversion: 2.1 time: 0.160563 Jun 20 14:55:59.156787 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 249/485] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:58 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:55:59.505405 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2949218c-ad53-4b5d-8d1e-2e778c1234e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:59.506004 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2949218c-ad53-4b5d-8d1e-2e778c1234e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:59.512405 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2949218c-ad53-4b5d-8d1e-2e778c1234e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:59.512815 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2949218c-ad53-4b5d-8d1e-2e778c1234e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:59.513576 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2949218c-ad53-4b5d-8d1e-2e778c1234e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:59.514001 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2949218c-ad53-4b5d-8d1e-2e778c1234e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:59.663939 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2949218c-ad53-4b5d-8d1e-2e778c1234e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:59.674514 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2949218c-ad53-4b5d-8d1e-2e778c1234e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:59.676019 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2949218c-ad53-4b5d-8d1e-2e778c1234e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:55:59.677302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2949218c-ad53-4b5d-8d1e-2e778c1234e8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.175871 Jun 20 14:55:59.677897 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 237/486] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:55:59 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:55:59.968520 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-84caa615-6ca7-4613-8655-99044a179192 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:55:59.969184 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-84caa615-6ca7-4613-8655-99044a179192 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:55:59.971059 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:59.976733 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-84caa615-6ca7-4613-8655-99044a179192 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:59.977189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-84caa615-6ca7-4613-8655-99044a179192 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:55:59.977941 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-84caa615-6ca7-4613-8655-99044a179192 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:55:59.978389 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-84caa615-6ca7-4613-8655-99044a179192 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:00.044211 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-84caa615-6ca7-4613-8655-99044a179192 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:00.052437 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-84caa615-6ca7-4613-8655-99044a179192 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1245 microversion: 2.1 time: 0.088924 Jun 20 14:56:00.053047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 250/487] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:55:59 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:00.175888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-53dc7026-7f0f-4348-878a-ffd202783eee tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:00.176462 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-53dc7026-7f0f-4348-878a-ffd202783eee tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:00.179057 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:00.186002 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-53dc7026-7f0f-4348-878a-ffd202783eee tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:00.186590 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-53dc7026-7f0f-4348-878a-ffd202783eee tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:00.187627 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-53dc7026-7f0f-4348-878a-ffd202783eee tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:00.188138 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-53dc7026-7f0f-4348-878a-ffd202783eee tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:00.326961 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-53dc7026-7f0f-4348-878a-ffd202783eee tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:00.335407 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-53dc7026-7f0f-4348-878a-ffd202783eee tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1736 microversion: 2.1 time: 0.163525 Jun 20 14:56:00.335979 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 238/488] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:00 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:00.696932 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-f4dfff23-6228-4f4a-97a3-37a40f58aa25 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:00.697598 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-f4dfff23-6228-4f4a-97a3-37a40f58aa25 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:00.704616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f4dfff23-6228-4f4a-97a3-37a40f58aa25 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:00.705145 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f4dfff23-6228-4f4a-97a3-37a40f58aa25 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:00.706042 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f4dfff23-6228-4f4a-97a3-37a40f58aa25 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:00.706557 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f4dfff23-6228-4f4a-97a3-37a40f58aa25 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:00.850175 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-f4dfff23-6228-4f4a-97a3-37a40f58aa25 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:00.858697 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-f4dfff23-6228-4f4a-97a3-37a40f58aa25 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:00.860177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-f4dfff23-6228-4f4a-97a3-37a40f58aa25 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:00.861353 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-f4dfff23-6228-4f4a-97a3-37a40f58aa25 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.168732 Jun 20 14:56:00.861947 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 251/489] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:56:00 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:56:01.070736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-aa0fce75-c4ff-441d-81c8-7c3216bcbe4e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:01.071347 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-aa0fce75-c4ff-441d-81c8-7c3216bcbe4e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:01.078396 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-aa0fce75-c4ff-441d-81c8-7c3216bcbe4e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:01.078872 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-aa0fce75-c4ff-441d-81c8-7c3216bcbe4e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:01.079634 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-aa0fce75-c4ff-441d-81c8-7c3216bcbe4e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:01.080123 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-aa0fce75-c4ff-441d-81c8-7c3216bcbe4e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:01.151895 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-aa0fce75-c4ff-441d-81c8-7c3216bcbe4e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:01.160480 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-aa0fce75-c4ff-441d-81c8-7c3216bcbe4e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1293 microversion: 2.1 time: 0.093766 Jun 20 14:56:01.161064 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 239/490] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:01 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:01.354449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7f2d3ea6-3376-405c-b48b-777de395fb41 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:01.355077 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7f2d3ea6-3376-405c-b48b-777de395fb41 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:01.362851 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7f2d3ea6-3376-405c-b48b-777de395fb41 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:01.363304 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7f2d3ea6-3376-405c-b48b-777de395fb41 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:01.364147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7f2d3ea6-3376-405c-b48b-777de395fb41 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:01.365431 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7f2d3ea6-3376-405c-b48b-777de395fb41 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:01.506596 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7f2d3ea6-3376-405c-b48b-777de395fb41 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:01.514667 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7f2d3ea6-3376-405c-b48b-777de395fb41 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1736 microversion: 2.1 time: 0.165097 Jun 20 14:56:01.515260 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 252/491] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:01 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:01.880551 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3f8b3d0f-af3b-4bf4-baf2-af1183a8b502 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:01.881331 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-3f8b3d0f-af3b-4bf4-baf2-af1183a8b502 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:01.888847 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3f8b3d0f-af3b-4bf4-baf2-af1183a8b502 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:01.889278 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3f8b3d0f-af3b-4bf4-baf2-af1183a8b502 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:01.890034 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3f8b3d0f-af3b-4bf4-baf2-af1183a8b502 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:01.890452 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3f8b3d0f-af3b-4bf4-baf2-af1183a8b502 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:02.156479 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3f8b3d0f-af3b-4bf4-baf2-af1183a8b502 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:02.166828 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3f8b3d0f-af3b-4bf4-baf2-af1183a8b502 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:02.168854 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3f8b3d0f-af3b-4bf4-baf2-af1183a8b502 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:02.170079 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-3f8b3d0f-af3b-4bf4-baf2-af1183a8b502 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.293587 Jun 20 14:56:02.170827 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 240/492] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:56:01 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:56:02.187823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8bf12ed5-1b9a-4989-a0a6-ca65a6b4c6b6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:02.188432 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-8bf12ed5-1b9a-4989-a0a6-ca65a6b4c6b6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:02.194945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8bf12ed5-1b9a-4989-a0a6-ca65a6b4c6b6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:02.195393 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8bf12ed5-1b9a-4989-a0a6-ca65a6b4c6b6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:02.196154 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8bf12ed5-1b9a-4989-a0a6-ca65a6b4c6b6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:02.196585 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8bf12ed5-1b9a-4989-a0a6-ca65a6b4c6b6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:02.261014 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8bf12ed5-1b9a-4989-a0a6-ca65a6b4c6b6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:02.269201 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-8bf12ed5-1b9a-4989-a0a6-ca65a6b4c6b6 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1299 microversion: 2.1 time: 0.085560 Jun 20 14:56:02.269756 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 253/493] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:02 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:02.531582 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-a3047ebe-277e-4072-892e-5d59a3789691 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:02.532181 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-a3047ebe-277e-4072-892e-5d59a3789691 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:02.538617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a3047ebe-277e-4072-892e-5d59a3789691 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:02.539061 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a3047ebe-277e-4072-892e-5d59a3789691 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:02.539823 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a3047ebe-277e-4072-892e-5d59a3789691 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:02.540256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a3047ebe-277e-4072-892e-5d59a3789691 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:02.745298 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-a3047ebe-277e-4072-892e-5d59a3789691 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:02.753567 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-a3047ebe-277e-4072-892e-5d59a3789691 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1736 microversion: 2.1 time: 0.225935 Jun 20 14:56:02.754152 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 241/494] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:02 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:03.191305 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e66ec198-5a0b-4db0-82b0-844079a0aac9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:03.192164 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e66ec198-5a0b-4db0-82b0-844079a0aac9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:03.199502 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e66ec198-5a0b-4db0-82b0-844079a0aac9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:03.199990 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e66ec198-5a0b-4db0-82b0-844079a0aac9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:03.200820 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e66ec198-5a0b-4db0-82b0-844079a0aac9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:03.201245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e66ec198-5a0b-4db0-82b0-844079a0aac9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:03.289744 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7222ef9c-42b3-4d0b-9500-35fb0653cf1d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:03.290358 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7222ef9c-42b3-4d0b-9500-35fb0653cf1d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:03.297006 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=4 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:03.299658 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7222ef9c-42b3-4d0b-9500-35fb0653cf1d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:03.300556 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7222ef9c-42b3-4d0b-9500-35fb0653cf1d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:03.301726 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7222ef9c-42b3-4d0b-9500-35fb0653cf1d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:03.302315 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7222ef9c-42b3-4d0b-9500-35fb0653cf1d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:03.347557 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e66ec198-5a0b-4db0-82b0-844079a0aac9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:03.356166 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e66ec198-5a0b-4db0-82b0-844079a0aac9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:03.357898 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e66ec198-5a0b-4db0-82b0-844079a0aac9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:03.359059 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e66ec198-5a0b-4db0-82b0-844079a0aac9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.172536 Jun 20 14:56:03.359617 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 254/495] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:56:03 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:56:03.531167 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-7222ef9c-42b3-4d0b-9500-35fb0653cf1d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:03.539063 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7222ef9c-42b3-4d0b-9500-35fb0653cf1d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1366 microversion: 2.1 time: 0.253128 Jun 20 14:56:03.539880 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 242/496] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:03 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:03.771575 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-70fa9ab2-3439-4b2b-9b7b-64ee37ef5f40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:03.772183 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-70fa9ab2-3439-4b2b-9b7b-64ee37ef5f40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:03.778497 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-70fa9ab2-3439-4b2b-9b7b-64ee37ef5f40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:03.778946 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-70fa9ab2-3439-4b2b-9b7b-64ee37ef5f40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:03.779802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-70fa9ab2-3439-4b2b-9b7b-64ee37ef5f40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:03.780298 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-70fa9ab2-3439-4b2b-9b7b-64ee37ef5f40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:03.843457 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-89a5924d-e084-40e1-bbae-31f5ee4e54ea req-743bdb51-08a1-4272-9ff5-07c85b1d7486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc2b001-2afc-4387-bc75-f9a40d79d9ac", "tag": "6618345b-185a-4b31-8a55-c40aa36c68e5"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:56:03.857120 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-89a5924d-e084-40e1-bbae-31f5ee4e54ea req-743bdb51-08a1-4272-9ff5-07c85b1d7486 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:03.857687 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-89a5924d-e084-40e1-bbae-31f5ee4e54ea req-743bdb51-08a1-4272-9ff5-07c85b1d7486 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:03.882983 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-89a5924d-e084-40e1-bbae-31f5ee4e54ea req-743bdb51-08a1-4272-9ff5-07c85b1d7486 service nova] Creating event network-changed:6618345b-185a-4b31-8a55-c40aa36c68e5 for instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac on hv-cinder-83697 Jun 20 14:56:03.891529 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-89a5924d-e084-40e1-bbae-31f5ee4e54ea req-743bdb51-08a1-4272-9ff5-07c85b1d7486 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053161 Jun 20 14:56:03.893641 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 243/497] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 14:56:03.946606 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-70fa9ab2-3439-4b2b-9b7b-64ee37ef5f40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:03.955021 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-70fa9ab2-3439-4b2b-9b7b-64ee37ef5f40 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1716 microversion: 2.1 time: 0.187339 Jun 20 14:56:03.955596 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 255/498] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:03 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1716 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:04.073488 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1a7f3bf7-bd12-425b-9c65-23a9906493b1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:04.074071 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1a7f3bf7-bd12-425b-9c65-23a9906493b1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:04.080471 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1a7f3bf7-bd12-425b-9c65-23a9906493b1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:04.080953 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1a7f3bf7-bd12-425b-9c65-23a9906493b1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:04.081732 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1a7f3bf7-bd12-425b-9c65-23a9906493b1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:04.082150 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1a7f3bf7-bd12-425b-9c65-23a9906493b1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:04.165813 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-1a7f3bf7-bd12-425b-9c65-23a9906493b1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] HTTP exception thrown: Cannot 'detach_volume' instance 68161747-6331-4819-a01b-24d3d5e80563 while it is in vm_state rescued Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1a7f3bf7-bd12-425b-9c65-23a9906493b1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Request method failure captured: Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: DELETE /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/os-volume_attachments/e3263d7f-d493-4008-9bad-8dfa10f9109c HTTP/1.1 Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImcHJuSa1U2mDQw9Je2xMgVwCoBOENl4iMW3vovpnSsB3iLV2Wky6amoiYaxxO44qc2Z72Jit4az7ijT7wcCAZNHNcWZrT6z4FDrbh0ShQZbRnswOu_dl12QuYvC9Bxopa25pVc9jmSmMGQBHZ-89TuG0RSht7skWN3u3AnyB050GU Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: 1333ac4890624e11941a2681b51b07ab Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1970379770 Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:56:04.167419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:56:04.169043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1333ac4890624e11941a2681b51b07ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1333ac4890624e11941a2681b51b07ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1333ac4890624e11941a2681b51b07ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1333ac4890624e11941a2681b51b07ab"}]}] Jun 20 14:56:04.169043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1970379770 Jun 20 14:56:04.169043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: 1333ac4890624e11941a2681b51b07ab Jun 20 14:56:04.169043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1970379770 Jun 20 14:56:04.169043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-ServerRescueNegativeTestJSON-1970379770-project Jun 20 14:56:04.169043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:56:04.169043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:56:04.169043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: afc8379be09748a68ade6af9b99cdfa2 Jun 20 14:56:04.169043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1970379770-project Jun 20 14:56:04.169043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:56:04.169043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Cannot 'detach_volume' instance 68161747-6331-4819-a01b-24d3d5e80563 while it is in vm_state rescued Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'server_id': '68161747-6331-4819-a01b-24d3d5e80563', 'id': 'e3263d7f-d493-4008-9bad-8dfa10f9109c'} Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 68161747-6331-4819-a01b-24d3d5e80563 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:56:04.169807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 68161747-6331-4819-a01b-24d3d5e80563 while it is in vm_state rescued Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 68161747-6331-4819-a01b-24d3d5e80563 while it is in vm_state rescued Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:56:04.171104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1a7f3bf7-bd12-425b-9c65-23a9906493b1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Returning 409 to user: Cannot 'detach_volume' instance 68161747-6331-4819-a01b-24d3d5e80563 while it is in vm_state rescued {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:56:04.172047 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1a7f3bf7-bd12-425b-9c65-23a9906493b1 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "DELETE /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/os-volume_attachments/e3263d7f-d493-4008-9bad-8dfa10f9109c" status: 409 len: 152 microversion: 2.1 time: 0.100704 Jun 20 14:56:04.172047 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 244/499] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 14:56:04 2022] DELETE /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/os-volume_attachments/e3263d7f-d493-4008-9bad-8dfa10f9109c => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 14:56:04.177753 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-590b726a-c58e-41d4-9bae-4da62175b69f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:56:04.178275 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-590b726a-c58e-41d4-9bae-4da62175b69f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:04.184284 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-590b726a-c58e-41d4-9bae-4da62175b69f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:04.184906 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-590b726a-c58e-41d4-9bae-4da62175b69f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:04.185852 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-590b726a-c58e-41d4-9bae-4da62175b69f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:04.186280 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-590b726a-c58e-41d4-9bae-4da62175b69f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:04.261872 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-590b726a-c58e-41d4-9bae-4da62175b69f tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "POST /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/action" status: 202 len: 0 microversion: 2.1 time: 0.087632 Jun 20 14:56:04.263227 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 256/500] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 14:56:04 2022] POST /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 14:56:04.270895 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7bb3355f-6e87-4571-a130-8b517a4a5a63 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:04.271535 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7bb3355f-6e87-4571-a130-8b517a4a5a63 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:04.277669 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7bb3355f-6e87-4571-a130-8b517a4a5a63 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:04.278159 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7bb3355f-6e87-4571-a130-8b517a4a5a63 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:04.279402 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7bb3355f-6e87-4571-a130-8b517a4a5a63 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:04.279402 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7bb3355f-6e87-4571-a130-8b517a4a5a63 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:04.378136 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9fb82df4-550d-4248-b5b9-bc94c1590371 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:04.378824 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9fb82df4-550d-4248-b5b9-bc94c1590371 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:04.385959 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9fb82df4-550d-4248-b5b9-bc94c1590371 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:04.386365 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9fb82df4-550d-4248-b5b9-bc94c1590371 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:04.387118 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9fb82df4-550d-4248-b5b9-bc94c1590371 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:04.387594 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9fb82df4-550d-4248-b5b9-bc94c1590371 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:04.464517 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-7bb3355f-6e87-4571-a130-8b517a4a5a63 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:04.473225 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7bb3355f-6e87-4571-a130-8b517a4a5a63 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1724 microversion: 2.1 time: 0.206136 Jun 20 14:56:04.473806 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 245/501] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:04 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:04.525863 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9fb82df4-550d-4248-b5b9-bc94c1590371 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:04.535567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9fb82df4-550d-4248-b5b9-bc94c1590371 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:04.537084 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9fb82df4-550d-4248-b5b9-bc94c1590371 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:04.538226 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9fb82df4-550d-4248-b5b9-bc94c1590371 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.164428 Jun 20 14:56:04.538787 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 257/502] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:56:04 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:56:04.557519 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f1ba65bd-1fad-40eb-a3ce-7465dd3240ae tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:04.558055 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f1ba65bd-1fad-40eb-a3ce-7465dd3240ae tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:04.564832 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1ba65bd-1fad-40eb-a3ce-7465dd3240ae tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:04.565303 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1ba65bd-1fad-40eb-a3ce-7465dd3240ae tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:04.566048 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1ba65bd-1fad-40eb-a3ce-7465dd3240ae tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:04.566464 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1ba65bd-1fad-40eb-a3ce-7465dd3240ae tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:04.699019 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f1ba65bd-1fad-40eb-a3ce-7465dd3240ae tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:04.710797 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f1ba65bd-1fad-40eb-a3ce-7465dd3240ae tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1366 microversion: 2.1 time: 0.156966 Jun 20 14:56:04.711541 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 246/503] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:04 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:05.491547 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2b91b3c2-1035-41b5-91ff-ecfe5c21cf51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:05.492163 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-2b91b3c2-1035-41b5-91ff-ecfe5c21cf51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:05.494701 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:05.501538 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2b91b3c2-1035-41b5-91ff-ecfe5c21cf51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:05.501990 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2b91b3c2-1035-41b5-91ff-ecfe5c21cf51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:05.502773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2b91b3c2-1035-41b5-91ff-ecfe5c21cf51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:05.503207 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2b91b3c2-1035-41b5-91ff-ecfe5c21cf51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:05.556482 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2b2c09e8-fa39-4be3-8f69-86ae81598cad tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:05.557788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2b2c09e8-fa39-4be3-8f69-86ae81598cad tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:05.565381 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2b2c09e8-fa39-4be3-8f69-86ae81598cad tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:05.565800 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2b2c09e8-fa39-4be3-8f69-86ae81598cad tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:05.566574 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2b2c09e8-fa39-4be3-8f69-86ae81598cad tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:05.566989 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2b2c09e8-fa39-4be3-8f69-86ae81598cad tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:05.583838 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=8 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:05.644194 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-2b91b3c2-1035-41b5-91ff-ecfe5c21cf51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:05.647751 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:05.653608 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-2b91b3c2-1035-41b5-91ff-ecfe5c21cf51 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1724 microversion: 2.1 time: 0.165932 Jun 20 14:56:05.654194 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 258/504] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:05 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:05.730352 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e31f539a-bf1f-4bd6-8ef4-f4c09f703e03 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:05.731070 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e31f539a-bf1f-4bd6-8ef4-f4c09f703e03 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:05.738868 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e31f539a-bf1f-4bd6-8ef4-f4c09f703e03 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:05.739412 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e31f539a-bf1f-4bd6-8ef4-f4c09f703e03 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:05.740250 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e31f539a-bf1f-4bd6-8ef4-f4c09f703e03 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:05.740690 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e31f539a-bf1f-4bd6-8ef4-f4c09f703e03 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:05.883647 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e31f539a-bf1f-4bd6-8ef4-f4c09f703e03 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:05.891953 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e31f539a-bf1f-4bd6-8ef4-f4c09f703e03 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1366 microversion: 2.1 time: 0.166233 Jun 20 14:56:05.892535 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 259/505] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:05 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:05.920813 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2b2c09e8-fa39-4be3-8f69-86ae81598cad tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:05.929708 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2b2c09e8-fa39-4be3-8f69-86ae81598cad tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:05.931195 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2b2c09e8-fa39-4be3-8f69-86ae81598cad tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:05.932345 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2b2c09e8-fa39-4be3-8f69-86ae81598cad tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.379917 Jun 20 14:56:05.933014 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 247/506] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:56:05 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:56:06.675357 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6ad21dea-5ad7-4f16-af92-0df746551a9c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:06.676500 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-6ad21dea-5ad7-4f16-af92-0df746551a9c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:06.686534 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6ad21dea-5ad7-4f16-af92-0df746551a9c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:06.687311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6ad21dea-5ad7-4f16-af92-0df746551a9c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:06.688082 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6ad21dea-5ad7-4f16-af92-0df746551a9c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:06.688513 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6ad21dea-5ad7-4f16-af92-0df746551a9c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:06.820423 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6ad21dea-5ad7-4f16-af92-0df746551a9c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:06.829078 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6ad21dea-5ad7-4f16-af92-0df746551a9c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1724 microversion: 2.1 time: 0.160205 Jun 20 14:56:06.829770 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 260/507] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:06 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:06.909248 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-097b1abd-8548-4bf2-9368-43ef9d4534f1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:06.909851 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-097b1abd-8548-4bf2-9368-43ef9d4534f1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:06.916945 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-097b1abd-8548-4bf2-9368-43ef9d4534f1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:06.917688 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-097b1abd-8548-4bf2-9368-43ef9d4534f1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:06.918415 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-097b1abd-8548-4bf2-9368-43ef9d4534f1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:06.918945 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-097b1abd-8548-4bf2-9368-43ef9d4534f1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:06.951044 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6802685b-9194-4689-8f52-47c33a480b7c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:06.951651 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-6802685b-9194-4689-8f52-47c33a480b7c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:06.957975 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6802685b-9194-4689-8f52-47c33a480b7c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:06.958422 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6802685b-9194-4689-8f52-47c33a480b7c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:06.959184 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6802685b-9194-4689-8f52-47c33a480b7c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:06.959615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6802685b-9194-4689-8f52-47c33a480b7c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:07.097173 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6802685b-9194-4689-8f52-47c33a480b7c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:07.110968 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6802685b-9194-4689-8f52-47c33a480b7c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:07.113009 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6802685b-9194-4689-8f52-47c33a480b7c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:07.115120 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6802685b-9194-4689-8f52-47c33a480b7c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.168044 Jun 20 14:56:07.115844 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 261/508] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:56:06 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:56:07.127617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-097b1abd-8548-4bf2-9368-43ef9d4534f1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:07.131240 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=100 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:07.136232 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-097b1abd-8548-4bf2-9368-43ef9d4534f1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1366 microversion: 2.1 time: 0.230961 Jun 20 14:56:07.136822 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 248/509] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:06 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:07.847217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-66ec93ae-0c95-45fe-92af-93d52cb147df tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:07.847820 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-66ec93ae-0c95-45fe-92af-93d52cb147df tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:07.855162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-66ec93ae-0c95-45fe-92af-93d52cb147df tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:07.855661 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-66ec93ae-0c95-45fe-92af-93d52cb147df tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:07.857723 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-66ec93ae-0c95-45fe-92af-93d52cb147df tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:07.858167 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-66ec93ae-0c95-45fe-92af-93d52cb147df tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:07.994877 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-66ec93ae-0c95-45fe-92af-93d52cb147df tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:08.007162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-66ec93ae-0c95-45fe-92af-93d52cb147df tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1724 microversion: 2.1 time: 0.163711 Jun 20 14:56:08.007993 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 262/510] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:07 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:08.138092 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d7267f92-1f87-4219-9384-b8080d9302a1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:08.139078 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-d7267f92-1f87-4219-9384-b8080d9302a1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:08.151105 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d7267f92-1f87-4219-9384-b8080d9302a1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:08.152061 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d7267f92-1f87-4219-9384-b8080d9302a1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:08.153536 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d7267f92-1f87-4219-9384-b8080d9302a1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:08.154395 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d7267f92-1f87-4219-9384-b8080d9302a1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:08.156240 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-c68c6065-4da7-45e7-9346-5e7201fa1f9f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:08.156888 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-c68c6065-4da7-45e7-9346-5e7201fa1f9f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:08.163406 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c68c6065-4da7-45e7-9346-5e7201fa1f9f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:08.163869 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c68c6065-4da7-45e7-9346-5e7201fa1f9f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:08.164674 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c68c6065-4da7-45e7-9346-5e7201fa1f9f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:08.165134 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c68c6065-4da7-45e7-9346-5e7201fa1f9f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:08.287609 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d7267f92-1f87-4219-9384-b8080d9302a1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:08.296570 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d7267f92-1f87-4219-9384-b8080d9302a1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:08.297572 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-c68c6065-4da7-45e7-9346-5e7201fa1f9f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:08.298093 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d7267f92-1f87-4219-9384-b8080d9302a1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:08.299243 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d7267f92-1f87-4219-9384-b8080d9302a1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.167827 Jun 20 14:56:08.299795 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 249/511] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:56:08 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:56:08.305289 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-c68c6065-4da7-45e7-9346-5e7201fa1f9f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1366 microversion: 2.1 time: 0.154928 Jun 20 14:56:08.305840 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 263/512] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:08 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:09.027570 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-a4cf54e2-3c73-4089-b601-b1d44914fcb8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:09.027570 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-a4cf54e2-3c73-4089-b601-b1d44914fcb8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:09.034495 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a4cf54e2-3c73-4089-b601-b1d44914fcb8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:09.034935 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a4cf54e2-3c73-4089-b601-b1d44914fcb8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:09.035719 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a4cf54e2-3c73-4089-b601-b1d44914fcb8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:09.036152 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a4cf54e2-3c73-4089-b601-b1d44914fcb8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:09.179473 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-a4cf54e2-3c73-4089-b601-b1d44914fcb8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:09.188312 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-a4cf54e2-3c73-4089-b601-b1d44914fcb8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1730 microversion: 2.1 time: 0.165260 Jun 20 14:56:09.188914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 250/513] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:09 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:09.205048 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-72f0a851-266e-47be-bc5f-fcc93a9796d6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:09.205564 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-72f0a851-266e-47be-bc5f-fcc93a9796d6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:09.212473 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-72f0a851-266e-47be-bc5f-fcc93a9796d6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:09.212958 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-72f0a851-266e-47be-bc5f-fcc93a9796d6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:09.213727 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-72f0a851-266e-47be-bc5f-fcc93a9796d6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:09.214156 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-72f0a851-266e-47be-bc5f-fcc93a9796d6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:09.301700 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-72f0a851-266e-47be-bc5f-fcc93a9796d6 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100619 Jun 20 14:56:09.302302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 264/514] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 14:56:09 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:09.321391 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-93cb708c-58e4-4038-8b66-eda1a9bf3b0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:09.322073 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-93cb708c-58e4-4038-8b66-eda1a9bf3b0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:09.325888 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-f106994a-3996-4399-9520-4e1e5588ef44 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:09.326596 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-f106994a-3996-4399-9520-4e1e5588ef44 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:09.329059 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-93cb708c-58e4-4038-8b66-eda1a9bf3b0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:09.329552 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-93cb708c-58e4-4038-8b66-eda1a9bf3b0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:09.330529 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-93cb708c-58e4-4038-8b66-eda1a9bf3b0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:09.331148 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-93cb708c-58e4-4038-8b66-eda1a9bf3b0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:09.342057 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f106994a-3996-4399-9520-4e1e5588ef44 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:09.343304 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f106994a-3996-4399-9520-4e1e5588ef44 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:09.344265 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f106994a-3996-4399-9520-4e1e5588ef44 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:09.345345 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f106994a-3996-4399-9520-4e1e5588ef44 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:09.486932 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-93cb708c-58e4-4038-8b66-eda1a9bf3b0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:09.496179 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-93cb708c-58e4-4038-8b66-eda1a9bf3b0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:09.497837 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-93cb708c-58e4-4038-8b66-eda1a9bf3b0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:09.499138 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-93cb708c-58e4-4038-8b66-eda1a9bf3b0d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.181978 Jun 20 14:56:09.499774 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 251/515] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:56:09 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:56:09.587785 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-f106994a-3996-4399-9520-4e1e5588ef44 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:09.597652 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-f106994a-3996-4399-9520-4e1e5588ef44 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1366 microversion: 2.1 time: 0.277016 Jun 20 14:56:09.608204 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 265/516] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:09 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:09.723769 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-ef570ac0-9a69-43ee-b2bd-6a4f113bec2e req-db8f1092-6b10-4487-abbf-a912e52eb9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc2b001-2afc-4387-bc75-f9a40d79d9ac", "name": "network-vif-plugged", "status": "completed", "tag": "6618345b-185a-4b31-8a55-c40aa36c68e5"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:56:09.733940 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-ef570ac0-9a69-43ee-b2bd-6a4f113bec2e req-db8f1092-6b10-4487-abbf-a912e52eb9a6 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:09.734465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-ef570ac0-9a69-43ee-b2bd-6a4f113bec2e req-db8f1092-6b10-4487-abbf-a912e52eb9a6 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:09.746574 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-ef570ac0-9a69-43ee-b2bd-6a4f113bec2e req-db8f1092-6b10-4487-abbf-a912e52eb9a6 service nova] Creating event network-vif-plugged:6618345b-185a-4b31-8a55-c40aa36c68e5 for instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac on hv-cinder-83697 Jun 20 14:56:09.751785 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-ef570ac0-9a69-43ee-b2bd-6a4f113bec2e req-db8f1092-6b10-4487-abbf-a912e52eb9a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031693 Jun 20 14:56:09.752399 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 252/517] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:10.518720 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-f749e03f-f1d9-493c-870b-bd4b14784941 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:10.519564 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-f749e03f-f1d9-493c-870b-bd4b14784941 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:10.527281 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f749e03f-f1d9-493c-870b-bd4b14784941 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:10.527891 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f749e03f-f1d9-493c-870b-bd4b14784941 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:10.528670 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f749e03f-f1d9-493c-870b-bd4b14784941 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:10.529133 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f749e03f-f1d9-493c-870b-bd4b14784941 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:10.577223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-0387b610-b78a-4fcd-9203-2649c807898b req-0c6ae6e8-f26d-47d0-815c-80074f3d0c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68161747-6331-4819-a01b-24d3d5e80563", "tag": "ba17c8d3-ed5f-4cf2-8dbe-b795150fcdf8"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:56:10.586366 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-0387b610-b78a-4fcd-9203-2649c807898b req-0c6ae6e8-f26d-47d0-815c-80074f3d0c0e service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:10.586802 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-0387b610-b78a-4fcd-9203-2649c807898b req-0c6ae6e8-f26d-47d0-815c-80074f3d0c0e service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:10.598842 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-0387b610-b78a-4fcd-9203-2649c807898b req-0c6ae6e8-f26d-47d0-815c-80074f3d0c0e service nova] Creating event network-changed:ba17c8d3-ed5f-4cf2-8dbe-b795150fcdf8 for instance 68161747-6331-4819-a01b-24d3d5e80563 on hv-cinder-83697 Jun 20 14:56:10.603969 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-0387b610-b78a-4fcd-9203-2649c807898b req-0c6ae6e8-f26d-47d0-815c-80074f3d0c0e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030840 Jun 20 14:56:10.604771 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 253/518] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:10.618914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-9d15f7cd-40c6-4da2-892e-921c9682c085 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:10.619772 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-9d15f7cd-40c6-4da2-892e-921c9682c085 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:10.626369 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9d15f7cd-40c6-4da2-892e-921c9682c085 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:10.626877 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9d15f7cd-40c6-4da2-892e-921c9682c085 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:10.627702 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9d15f7cd-40c6-4da2-892e-921c9682c085 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:10.628293 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9d15f7cd-40c6-4da2-892e-921c9682c085 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:10.697440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-f749e03f-f1d9-493c-870b-bd4b14784941 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:10.706880 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-f749e03f-f1d9-493c-870b-bd4b14784941 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:10.708369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-f749e03f-f1d9-493c-870b-bd4b14784941 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:10.709568 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-f749e03f-f1d9-493c-870b-bd4b14784941 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.195328 Jun 20 14:56:10.710259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 266/519] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:56:10 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:56:10.772755 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-9d15f7cd-40c6-4da2-892e-921c9682c085 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:10.780403 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-9d15f7cd-40c6-4da2-892e-921c9682c085 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1366 microversion: 2.1 time: 0.169291 Jun 20 14:56:10.781112 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 254/520] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:10 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:11.727637 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-85e93188-a54b-46f0-b815-89f172e74cd8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:11.728251 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-85e93188-a54b-46f0-b815-89f172e74cd8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:11.735068 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-85e93188-a54b-46f0-b815-89f172e74cd8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:11.735540 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-85e93188-a54b-46f0-b815-89f172e74cd8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:11.736444 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-85e93188-a54b-46f0-b815-89f172e74cd8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:11.736928 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-85e93188-a54b-46f0-b815-89f172e74cd8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:11.781266 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-5076e5f2-5a7a-4c1c-b225-fb9d9e4bfcfb req-9af4ca1b-d657-4469-af19-46d3f7cc3a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916159e1-4580-4bb4-a78f-857e9e15c61b", "name": "network-vif-plugged", "status": "completed", "tag": "4003555e-bf92-479e-b2dd-be6fe4500b56"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:56:11.789989 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-5076e5f2-5a7a-4c1c-b225-fb9d9e4bfcfb req-9af4ca1b-d657-4469-af19-46d3f7cc3a97 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:11.790564 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-5076e5f2-5a7a-4c1c-b225-fb9d9e4bfcfb req-9af4ca1b-d657-4469-af19-46d3f7cc3a97 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:11.803787 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-5076e5f2-5a7a-4c1c-b225-fb9d9e4bfcfb req-9af4ca1b-d657-4469-af19-46d3f7cc3a97 service nova] Creating event network-vif-plugged:4003555e-bf92-479e-b2dd-be6fe4500b56 for instance 916159e1-4580-4bb4-a78f-857e9e15c61b on hv-cinder-83697 Jun 20 14:56:11.810198 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-5076e5f2-5a7a-4c1c-b225-fb9d9e4bfcfb req-9af4ca1b-d657-4469-af19-46d3f7cc3a97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032704 Jun 20 14:56:11.811520 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 255/521] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:11.817112 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6338e990-3004-415f-8a15-db49081076cb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:11.817840 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6338e990-3004-415f-8a15-db49081076cb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:11.824443 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6338e990-3004-415f-8a15-db49081076cb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:11.824994 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6338e990-3004-415f-8a15-db49081076cb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:11.825789 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6338e990-3004-415f-8a15-db49081076cb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:11.826332 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6338e990-3004-415f-8a15-db49081076cb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:11.885216 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-85e93188-a54b-46f0-b815-89f172e74cd8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:11.894342 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-85e93188-a54b-46f0-b815-89f172e74cd8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:11.895881 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-85e93188-a54b-46f0-b815-89f172e74cd8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:11.897073 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-85e93188-a54b-46f0-b815-89f172e74cd8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.173420 Jun 20 14:56:11.897657 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 267/522] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:56:11 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:56:11.974875 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-6338e990-3004-415f-8a15-db49081076cb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:11.985950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6338e990-3004-415f-8a15-db49081076cb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1556 microversion: 2.1 time: 0.172726 Jun 20 14:56:11.986731 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 256/523] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:11 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:12.002617 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-248b31b9-8e06-4dc9-8d29-846faf6ba36f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:12.003100 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-248b31b9-8e06-4dc9-8d29-846faf6ba36f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:12.009503 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-248b31b9-8e06-4dc9-8d29-846faf6ba36f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:12.009918 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-248b31b9-8e06-4dc9-8d29-846faf6ba36f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:12.010706 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-248b31b9-8e06-4dc9-8d29-846faf6ba36f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:12.011130 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-248b31b9-8e06-4dc9-8d29-846faf6ba36f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:12.089574 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-248b31b9-8e06-4dc9-8d29-846faf6ba36f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090936 Jun 20 14:56:12.090171 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 268/524] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 14:56:11 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:12.632967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-42ccb622-7d41-44ba-97a6-9140d865570d req-e1a77d9f-c1cf-405b-aafb-063069f6f844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68161747-6331-4819-a01b-24d3d5e80563", "tag": "ba17c8d3-ed5f-4cf2-8dbe-b795150fcdf8"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:56:12.643243 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-42ccb622-7d41-44ba-97a6-9140d865570d req-e1a77d9f-c1cf-405b-aafb-063069f6f844 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:12.643677 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-42ccb622-7d41-44ba-97a6-9140d865570d req-e1a77d9f-c1cf-405b-aafb-063069f6f844 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:12.654666 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-42ccb622-7d41-44ba-97a6-9140d865570d req-e1a77d9f-c1cf-405b-aafb-063069f6f844 service nova] Creating event network-changed:ba17c8d3-ed5f-4cf2-8dbe-b795150fcdf8 for instance 68161747-6331-4819-a01b-24d3d5e80563 on hv-cinder-83697 Jun 20 14:56:12.659668 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-42ccb622-7d41-44ba-97a6-9140d865570d req-e1a77d9f-c1cf-405b-aafb-063069f6f844 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032513 Jun 20 14:56:12.660259 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 257/525] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:12.916017 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-33cee1b9-e992-475d-b536-a6dea52c5554 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:12.916594 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-33cee1b9-e992-475d-b536-a6dea52c5554 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:12.923800 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-33cee1b9-e992-475d-b536-a6dea52c5554 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:12.924249 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-33cee1b9-e992-475d-b536-a6dea52c5554 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:12.925246 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-33cee1b9-e992-475d-b536-a6dea52c5554 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:12.925662 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-33cee1b9-e992-475d-b536-a6dea52c5554 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:13.074485 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-33cee1b9-e992-475d-b536-a6dea52c5554 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:13.083377 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-33cee1b9-e992-475d-b536-a6dea52c5554 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:13.084883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-33cee1b9-e992-475d-b536-a6dea52c5554 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:13.086033 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-33cee1b9-e992-475d-b536-a6dea52c5554 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.174043 Jun 20 14:56:13.086563 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 269/526] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:56:12 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:56:13.597812 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-909b6429-6c2d-4ecc-b2dd-23970e86d936 req-8b9a2992-c4e0-4e13-9003-9df7934f51d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc2b001-2afc-4387-bc75-f9a40d79d9ac", "tag": "6618345b-185a-4b31-8a55-c40aa36c68e5"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:56:13.607371 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-909b6429-6c2d-4ecc-b2dd-23970e86d936 req-8b9a2992-c4e0-4e13-9003-9df7934f51d2 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:13.607878 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-909b6429-6c2d-4ecc-b2dd-23970e86d936 req-8b9a2992-c4e0-4e13-9003-9df7934f51d2 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:13.619034 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-909b6429-6c2d-4ecc-b2dd-23970e86d936 req-8b9a2992-c4e0-4e13-9003-9df7934f51d2 service nova] Creating event network-changed:6618345b-185a-4b31-8a55-c40aa36c68e5 for instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac on hv-cinder-83697 Jun 20 14:56:13.624461 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-909b6429-6c2d-4ecc-b2dd-23970e86d936 req-8b9a2992-c4e0-4e13-9003-9df7934f51d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030994 Jun 20 14:56:13.625332 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 258/527] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:14.105624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-be4f1e6f-b8a0-4e94-ac6f-04fbaee1c124 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:14.106891 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-be4f1e6f-b8a0-4e94-ac6f-04fbaee1c124 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:14.113598 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-be4f1e6f-b8a0-4e94-ac6f-04fbaee1c124 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:14.114043 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-be4f1e6f-b8a0-4e94-ac6f-04fbaee1c124 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:14.115043 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-be4f1e6f-b8a0-4e94-ac6f-04fbaee1c124 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:14.115479 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-be4f1e6f-b8a0-4e94-ac6f-04fbaee1c124 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:14.259862 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-be4f1e6f-b8a0-4e94-ac6f-04fbaee1c124 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:14.276334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-be4f1e6f-b8a0-4e94-ac6f-04fbaee1c124 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:14.278279 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-be4f1e6f-b8a0-4e94-ac6f-04fbaee1c124 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:14.287656 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-be4f1e6f-b8a0-4e94-ac6f-04fbaee1c124 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1810 microversion: 2.20 time: 0.185830 Jun 20 14:56:14.288761 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 270/528] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:56:14 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:56:15.308851 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d0de1ba7-70c2-47d9-b14b-fcf613e8c500 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:15.309429 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-d0de1ba7-70c2-47d9-b14b-fcf613e8c500 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:15.317446 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d0de1ba7-70c2-47d9-b14b-fcf613e8c500 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:15.317890 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d0de1ba7-70c2-47d9-b14b-fcf613e8c500 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:15.318703 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d0de1ba7-70c2-47d9-b14b-fcf613e8c500 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:15.319136 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d0de1ba7-70c2-47d9-b14b-fcf613e8c500 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:15.461219 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d0de1ba7-70c2-47d9-b14b-fcf613e8c500 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:15.474449 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d0de1ba7-70c2-47d9-b14b-fcf613e8c500 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:15.476988 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d0de1ba7-70c2-47d9-b14b-fcf613e8c500 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:15.478907 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d0de1ba7-70c2-47d9-b14b-fcf613e8c500 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1797 microversion: 2.20 time: 0.175771 Jun 20 14:56:15.479774 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 259/529] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:56:15 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1797 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:56:20.692867 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e8a7f824-b917-4c31-986d-40e1a8c8033a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-57145943"}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:56:20.693474 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e8a7f824-b917-4c31-986d-40e1a8c8033a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:20.700552 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e8a7f824-b917-4c31-986d-40e1a8c8033a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:20.701018 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e8a7f824-b917-4c31-986d-40e1a8c8033a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:20.701838 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e8a7f824-b917-4c31-986d-40e1a8c8033a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:20.702246 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e8a7f824-b917-4c31-986d-40e1a8c8033a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:20.836893 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.network.security_group_api [None req-e8a7f824-b917-4c31-986d-40e1a8c8033a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Removing security group b3c2f0ba-21f4-4695-aed2-061b56177e1f from port 6ee3c9d3-8185-4e24-b29a-20f7ceb97549 Jun 20 14:56:21.188929 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e8a7f824-b917-4c31-986d-40e1a8c8033a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "POST /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/action" status: 202 len: 0 microversion: 2.1 time: 0.499969 Jun 20 14:56:21.190009 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 271/530] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 14:56:20 2022] POST /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 14:56:21.198860 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-2e08f148-601a-4ff7-bfa7-a4b3e836d2b4 req-3927c4da-afed-4926-9c8e-a3d41cbd1e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e28018-9057-44e5-a730-871114cf6249", "tag": "6ee3c9d3-8185-4e24-b29a-20f7ceb97549"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:56:21.211030 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-2e08f148-601a-4ff7-bfa7-a4b3e836d2b4 req-3927c4da-afed-4926-9c8e-a3d41cbd1e2a service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:21.211476 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-2e08f148-601a-4ff7-bfa7-a4b3e836d2b4 req-3927c4da-afed-4926-9c8e-a3d41cbd1e2a service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:21.226303 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-2e08f148-601a-4ff7-bfa7-a4b3e836d2b4 req-3927c4da-afed-4926-9c8e-a3d41cbd1e2a service nova] Creating event network-changed:6ee3c9d3-8185-4e24-b29a-20f7ceb97549 for instance 33e28018-9057-44e5-a730-871114cf6249 on hv-cinder-83697 Jun 20 14:56:21.242506 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-2e08f148-601a-4ff7-bfa7-a4b3e836d2b4 req-3927c4da-afed-4926-9c8e-a3d41cbd1e2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047442 Jun 20 14:56:21.243203 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 260/531] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:22.421355 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-c1e1884c-85bf-447c-9b07-821e5f1ab28a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:22.421866 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-c1e1884c-85bf-447c-9b07-821e5f1ab28a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:22.428363 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c1e1884c-85bf-447c-9b07-821e5f1ab28a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:22.428853 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c1e1884c-85bf-447c-9b07-821e5f1ab28a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:22.429621 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c1e1884c-85bf-447c-9b07-821e5f1ab28a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:22.430055 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c1e1884c-85bf-447c-9b07-821e5f1ab28a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:22.568775 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.objects.instance [None req-c1e1884c-85bf-447c-9b07-821e5f1ab28a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lazy-loading 'services' on Instance uuid 33e28018-9057-44e5-a730-871114cf6249 {{(pid=123979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:56:22.699206 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-c1e1884c-85bf-447c-9b07-821e5f1ab28a tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/os-volume_attachments/f789ab21-1f36-46a0-8ccd-88160bf1d57b" status: 202 len: 0 microversion: 2.1 time: 0.282696 Jun 20 14:56:22.700004 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 272/532] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 14:56:22 2022] DELETE /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/os-volume_attachments/f789ab21-1f36-46a0-8ccd-88160bf1d57b => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 14:56:22.709896 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-98ea3fb1-2019-4018-be81-4f50a0451994 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:22.711007 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-98ea3fb1-2019-4018-be81-4f50a0451994 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:22.718248 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-98ea3fb1-2019-4018-be81-4f50a0451994 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:22.718831 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-98ea3fb1-2019-4018-be81-4f50a0451994 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:22.719633 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-98ea3fb1-2019-4018-be81-4f50a0451994 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:22.720120 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-98ea3fb1-2019-4018-be81-4f50a0451994 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:22.751651 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-98ea3fb1-2019-4018-be81-4f50a0451994 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046196 Jun 20 14:56:22.752295 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 261/533] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 14:56:22 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:23.257770 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-ef38c0c7-cf39-4049-8829-767cf5facd63 req-8df60d49-026a-4f3a-98c8-1221702edfad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e28018-9057-44e5-a730-871114cf6249", "tag": "6ee3c9d3-8185-4e24-b29a-20f7ceb97549"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:56:23.266446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-ef38c0c7-cf39-4049-8829-767cf5facd63 req-8df60d49-026a-4f3a-98c8-1221702edfad service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:23.266864 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-ef38c0c7-cf39-4049-8829-767cf5facd63 req-8df60d49-026a-4f3a-98c8-1221702edfad service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:23.279556 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-ef38c0c7-cf39-4049-8829-767cf5facd63 req-8df60d49-026a-4f3a-98c8-1221702edfad service nova] Creating event network-changed:6ee3c9d3-8185-4e24-b29a-20f7ceb97549 for instance 33e28018-9057-44e5-a730-871114cf6249 on hv-cinder-83697 Jun 20 14:56:23.285744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-ef38c0c7-cf39-4049-8829-767cf5facd63 req-8df60d49-026a-4f3a-98c8-1221702edfad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031893 Jun 20 14:56:23.286527 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 273/534] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:23.764037 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7807d7b6-defc-4b66-acdf-612cd947b8ca tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:23.765152 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7807d7b6-defc-4b66-acdf-612cd947b8ca tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:23.772094 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7807d7b6-defc-4b66-acdf-612cd947b8ca tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:23.772541 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7807d7b6-defc-4b66-acdf-612cd947b8ca tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:23.773340 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7807d7b6-defc-4b66-acdf-612cd947b8ca tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:23.773765 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7807d7b6-defc-4b66-acdf-612cd947b8ca tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:23.803725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7807d7b6-defc-4b66-acdf-612cd947b8ca tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043728 Jun 20 14:56:23.804289 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 262/535] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 14:56:23 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 14:56:23.815725 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e5102dc2-a8ca-486c-846b-2620861f9e91 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:23.816899 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e5102dc2-a8ca-486c-846b-2620861f9e91 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:23.824002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e5102dc2-a8ca-486c-846b-2620861f9e91 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:23.824453 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e5102dc2-a8ca-486c-846b-2620861f9e91 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:23.825372 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e5102dc2-a8ca-486c-846b-2620861f9e91 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:23.825988 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e5102dc2-a8ca-486c-846b-2620861f9e91 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:23.900327 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-e5102dc2-a8ca-486c-846b-2620861f9e91 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] HTTP exception thrown: Instance 33e28018-9057-44e5-a730-871114cf6249 is not attached to volume f789ab21-1f36-46a0-8ccd-88160bf1d57b Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e5102dc2-a8ca-486c-846b-2620861f9e91 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Request method failure captured: Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: DELETE /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/os-volume_attachments/f789ab21-1f36-46a0-8ccd-88160bf1d57b HTTP/1.1 Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisIny0fY6R2O4XabxnS5wVfh30F9_-NtMn4QeaIVsvdOPPZfv6hf0dDywd48ukYtzGUC7eHFFvVUz8666A45UlXssoYjv3kS6qn1zoTubiQEuThrqfxZwdqn9Md0G-pIRrIidNJ_bxVXmFPLvde2m3AsLStPyaHY4zmPe8Y59r6MquaQ Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: 7500725f7c744f318862323e13c5f23e Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-TestMinimumBasicScenario-68375755 Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:56:23.902744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:56:23.904090 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7500725f7c744f318862323e13c5f23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7500725f7c744f318862323e13c5f23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7500725f7c744f318862323e13c5f23e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7500725f7c744f318862323e13c5f23e"}]}] Jun 20 14:56:23.904090 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-TestMinimumBasicScenario-68375755 Jun 20 14:56:23.904090 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: 7500725f7c744f318862323e13c5f23e Jun 20 14:56:23.904090 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-TestMinimumBasicScenario-68375755 Jun 20 14:56:23.904090 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-TestMinimumBasicScenario-68375755-project Jun 20 14:56:23.904090 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:56:23.904090 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:56:23.904090 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: ad9a7c6755784828b967f1bef37f6441 Jun 20 14:56:23.904090 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-TestMinimumBasicScenario-68375755-project Jun 20 14:56:23.904090 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:56:23.904090 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance 33e28018-9057-44e5-a730-871114cf6249 is not attached to volume f789ab21-1f36-46a0-8ccd-88160bf1d57b Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'server_id': '33e28018-9057-44e5-a730-871114cf6249', 'id': 'f789ab21-1f36-46a0-8ccd-88160bf1d57b'} Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f789ab21-1f36-46a0-8ccd-88160bf1d57b. Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:56:23.904837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:56:23.906364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:56:23.906364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 20 14:56:23.906364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 14:56:23.906364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e28018-9057-44e5-a730-871114cf6249 is not attached to volume f789ab21-1f36-46a0-8ccd-88160bf1d57b Jun 20 14:56:23.906364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:56:23.906364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:56:23.906364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:56:23.906364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:56:23.906364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:56:23.906364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:56:23.906364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:56:23.906364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:56:23.906364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e28018-9057-44e5-a730-871114cf6249 is not attached to volume f789ab21-1f36-46a0-8ccd-88160bf1d57b Jun 20 14:56:23.906364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:56:23.906364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e5102dc2-a8ca-486c-846b-2620861f9e91 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Returning 404 to user: Instance 33e28018-9057-44e5-a730-871114cf6249 is not attached to volume f789ab21-1f36-46a0-8ccd-88160bf1d57b {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:56:23.907421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e5102dc2-a8ca-486c-846b-2620861f9e91 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/os-volume_attachments/f789ab21-1f36-46a0-8ccd-88160bf1d57b" status: 404 len: 154 microversion: 2.1 time: 0.093552 Jun 20 14:56:23.907421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 274/536] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 14:56:23 2022] DELETE /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249/os-volume_attachments/f789ab21-1f36-46a0-8ccd-88160bf1d57b => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:56:25.044445 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e89a14f8-a5e1-4cc1-b8cb-e096df8e9694 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:25.044957 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e89a14f8-a5e1-4cc1-b8cb-e096df8e9694 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:25.052103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e89a14f8-a5e1-4cc1-b8cb-e096df8e9694 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:25.052525 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e89a14f8-a5e1-4cc1-b8cb-e096df8e9694 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:25.053305 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e89a14f8-a5e1-4cc1-b8cb-e096df8e9694 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:25.053943 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e89a14f8-a5e1-4cc1-b8cb-e096df8e9694 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:25.079346 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e89a14f8-a5e1-4cc1-b8cb-e096df8e9694 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 14:56:25.157826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e89a14f8-a5e1-4cc1-b8cb-e096df8e9694 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 204 len: 0 microversion: 2.1 time: 0.116971 Jun 20 14:56:25.158339 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 263/537] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:56:25 2022] DELETE /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:56:25.168009 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1b088b3e-2143-4291-87fe-e08c21f1d798 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:25.168586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-1b088b3e-2143-4291-87fe-e08c21f1d798 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:25.175496 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1b088b3e-2143-4291-87fe-e08c21f1d798 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:25.175914 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1b088b3e-2143-4291-87fe-e08c21f1d798 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:25.176667 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1b088b3e-2143-4291-87fe-e08c21f1d798 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:25.177119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1b088b3e-2143-4291-87fe-e08c21f1d798 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:25.311119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-1b088b3e-2143-4291-87fe-e08c21f1d798 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:25.319354 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1b088b3e-2143-4291-87fe-e08c21f1d798 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1556 microversion: 2.1 time: 0.155586 Jun 20 14:56:25.319877 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 275/538] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:25 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:56:26.342213 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-578d5333-b9a6-49d1-ba02-2b4c15c06511 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:26.343200 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-578d5333-b9a6-49d1-ba02-2b4c15c06511 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:26.350671 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-578d5333-b9a6-49d1-ba02-2b4c15c06511 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:26.351110 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-578d5333-b9a6-49d1-ba02-2b4c15c06511 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:26.351857 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-578d5333-b9a6-49d1-ba02-2b4c15c06511 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:26.352284 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-578d5333-b9a6-49d1-ba02-2b4c15c06511 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:26.489259 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-578d5333-b9a6-49d1-ba02-2b4c15c06511 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:26.497402 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-578d5333-b9a6-49d1-ba02-2b4c15c06511 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1556 microversion: 2.1 time: 0.162540 Jun 20 14:56:26.497945 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 264/539] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:26 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:27.513923 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-5f7bb33b-4c7d-4525-8ecc-244c89b14523 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:27.514521 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-5f7bb33b-4c7d-4525-8ecc-244c89b14523 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:27.521720 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5f7bb33b-4c7d-4525-8ecc-244c89b14523 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:27.522162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5f7bb33b-4c7d-4525-8ecc-244c89b14523 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:27.522933 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5f7bb33b-4c7d-4525-8ecc-244c89b14523 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:27.523357 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5f7bb33b-4c7d-4525-8ecc-244c89b14523 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:27.542550 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:27.654323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-5f7bb33b-4c7d-4525-8ecc-244c89b14523 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9a7c6755784828b967f1bef37f6441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7500725f7c744f318862323e13c5f23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:27.661966 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-5f7bb33b-4c7d-4525-8ecc-244c89b14523 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 200 len: 1556 microversion: 2.1 time: 0.151970 Jun 20 14:56:27.662534 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 276/540] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:27 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:27.807449 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-1540f2d4-403e-4675-a4ce-8d8280f40ef1 req-0d4cbf1c-9b17-4459-9069-a82ffe9ca193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e28018-9057-44e5-a730-871114cf6249", "name": "network-vif-deleted", "tag": "6ee3c9d3-8185-4e24-b29a-20f7ceb97549"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:56:27.820998 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-1540f2d4-403e-4675-a4ce-8d8280f40ef1 req-0d4cbf1c-9b17-4459-9069-a82ffe9ca193 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:27.821664 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-1540f2d4-403e-4675-a4ce-8d8280f40ef1 req-0d4cbf1c-9b17-4459-9069-a82ffe9ca193 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:27.837817 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-1540f2d4-403e-4675-a4ce-8d8280f40ef1 req-0d4cbf1c-9b17-4459-9069-a82ffe9ca193 service nova] Creating event network-vif-deleted:6ee3c9d3-8185-4e24-b29a-20f7ceb97549 for instance 33e28018-9057-44e5-a730-871114cf6249 on hv-cinder-83697 Jun 20 14:56:27.842464 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-1540f2d4-403e-4675-a4ce-8d8280f40ef1 req-0d4cbf1c-9b17-4459-9069-a82ffe9ca193 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041295 Jun 20 14:56:27.843315 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 265/541] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:28.681779 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2dcd2500-72b4-475c-9098-0d82dba196e0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:28.682543 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-2dcd2500-72b4-475c-9098-0d82dba196e0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] [instance: 33e28018-9057-44e5-a730-871114cf6249] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:28.693007 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2dcd2500-72b4-475c-9098-0d82dba196e0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:28.693635 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2dcd2500-72b4-475c-9098-0d82dba196e0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:28.694792 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2dcd2500-72b4-475c-9098-0d82dba196e0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:28.695366 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2dcd2500-72b4-475c-9098-0d82dba196e0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:28.711770 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-2dcd2500-72b4-475c-9098-0d82dba196e0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] HTTP exception thrown: Instance 33e28018-9057-44e5-a730-871114cf6249 could not be found. Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2dcd2500-72b4-475c-9098-0d82dba196e0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Request method failure captured: Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 HTTP/1.1 Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisIny0fY6R2O4XabxnS5wVfh30F9_-NtMn4QeaIVsvdOPPZfv6hf0dDywd48ukYtzGUC7eHFFvVUz8666A45UlXssoYjv3kS6qn1zoTubiQEuThrqfxZwdqn9Md0G-pIRrIidNJ_bxVXmFPLvde2m3AsLStPyaHY4zmPe8Y59r6MquaQ Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: 7500725f7c744f318862323e13c5f23e Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-TestMinimumBasicScenario-68375755 Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:56:28.713291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:56:28.714819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7500725f7c744f318862323e13c5f23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7500725f7c744f318862323e13c5f23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7500725f7c744f318862323e13c5f23e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7500725f7c744f318862323e13c5f23e"}]}] Jun 20 14:56:28.714819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-TestMinimumBasicScenario-68375755 Jun 20 14:56:28.714819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: 7500725f7c744f318862323e13c5f23e Jun 20 14:56:28.714819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-TestMinimumBasicScenario-68375755 Jun 20 14:56:28.714819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-TestMinimumBasicScenario-68375755-project Jun 20 14:56:28.714819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:56:28.714819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:56:28.714819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: ad9a7c6755784828b967f1bef37f6441 Jun 20 14:56:28.714819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-TestMinimumBasicScenario-68375755-project Jun 20 14:56:28.714819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:56:28.714819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance 33e28018-9057-44e5-a730-871114cf6249 could not be found. Jun 20 14:56:28.714819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '33e28018-9057-44e5-a730-871114cf6249'} Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e28018-9057-44e5-a730-871114cf6249 could not be found. Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:56:28.715724 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e28018-9057-44e5-a730-871114cf6249 could not be found. Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e28018-9057-44e5-a730-871114cf6249 could not be found. Jun 20 14:56:28.717140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:56:28.718669 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2dcd2500-72b4-475c-9098-0d82dba196e0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Returning 404 to user: Instance 33e28018-9057-44e5-a730-871114cf6249 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:56:28.718669 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-2dcd2500-72b4-475c-9098-0d82dba196e0 tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249" status: 404 len: 111 microversion: 2.1 time: 0.039293 Jun 20 14:56:28.718669 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 277/542] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:28 2022] GET /compute/v2.1/servers/33e28018-9057-44e5-a730-871114cf6249 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:56:28.724042 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0b71f4eb-2191-4dfc-bf3f-816503ff50ac tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] Calling method '.version_select at 0x7fce509c31f0>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:28.744105 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0b71f4eb-2191-4dfc-bf3f-816503ff50ac tempest-TestMinimumBasicScenario-68375755 tempest-TestMinimumBasicScenario-68375755-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1900870198" status: 202 len: 0 microversion: 2.1 time: 0.024231 Jun 20 14:56:28.744669 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 266/543] 10.222.0.23 () {58 vars in 1271 bytes} [Mon Jun 20 14:56:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1900870198 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 14:56:46.731640 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=55 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:46.732566 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=4 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:46.927600 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3bfea868-2e79-4cf7-bf9a-0acb61184e1a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Action: 'create', calling method: .version_select at 0x7fce5131e040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2098402945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNpT1J0PZQ5nmPWMIQaroahzv3q4vh7V8cWYYmCje06kRpjKH0Vdp602EBSLwfBXTEqQwRLaWnoJwdSxM0sPTtpv2tWzUv5bsI+xM4c2ijrYE4tyXjgnwyQbFdIzRoYDA=="}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:56:46.950965 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-3bfea868-2e79-4cf7-bf9a-0acb61184e1a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Getting quotas for project c4515b09c1944036b62a40cc5e88719e. Resources: {'key_pairs'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:56:46.954872 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-3bfea868-2e79-4cf7-bf9a-0acb61184e1a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Getting quotas for user 3876008710b8469c9f65a24789a58067 and project c4515b09c1944036b62a40cc5e88719e. Resources: {'key_pairs'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:56:46.983030 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3bfea868-2e79-4cf7-bf9a-0acb61184e1a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.256598 Jun 20 14:56:46.983638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 278/544] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 14:56:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:48.502275 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:48.503121 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:48.507353 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-43da8672-c704-4c1d-8ec5-342fa7b572cc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:48.507946 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-43da8672-c704-4c1d-8ec5-342fa7b572cc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:48.515649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-43da8672-c704-4c1d-8ec5-342fa7b572cc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:48.516090 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-43da8672-c704-4c1d-8ec5-342fa7b572cc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:48.517014 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-43da8672-c704-4c1d-8ec5-342fa7b572cc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:48.517449 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-43da8672-c704-4c1d-8ec5-342fa7b572cc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:48.608109 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-43da8672-c704-4c1d-8ec5-342fa7b572cc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lazy-loading 'services' on Instance uuid 68161747-6331-4819-a01b-24d3d5e80563 {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:56:48.687475 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-43da8672-c704-4c1d-8ec5-342fa7b572cc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "DELETE /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/os-volume_attachments/e3263d7f-d493-4008-9bad-8dfa10f9109c" status: 202 len: 0 microversion: 2.1 time: 0.186384 Jun 20 14:56:48.688154 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 267/545] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 14:56:48 2022] DELETE /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/os-volume_attachments/e3263d7f-d493-4008-9bad-8dfa10f9109c => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 14:56:48.697744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b0474ba3-adfa-490d-ab51-f758a396007a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:48.699647 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-b0474ba3-adfa-490d-ab51-f758a396007a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:48.712812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b0474ba3-adfa-490d-ab51-f758a396007a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:48.713268 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b0474ba3-adfa-490d-ab51-f758a396007a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:48.714050 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b0474ba3-adfa-490d-ab51-f758a396007a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:48.715128 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b0474ba3-adfa-490d-ab51-f758a396007a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:48.749826 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-b0474ba3-adfa-490d-ab51-f758a396007a tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056963 Jun 20 14:56:48.750594 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 279/546] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 14:56:48 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:49.765315 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-786ca4f6-9bdf-4b70-930a-7e8aa6d4cb58 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:49.767281 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-786ca4f6-9bdf-4b70-930a-7e8aa6d4cb58 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:49.775715 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-786ca4f6-9bdf-4b70-930a-7e8aa6d4cb58 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:49.776156 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-786ca4f6-9bdf-4b70-930a-7e8aa6d4cb58 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:49.777171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-786ca4f6-9bdf-4b70-930a-7e8aa6d4cb58 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:49.777596 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-786ca4f6-9bdf-4b70-930a-7e8aa6d4cb58 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:49.811989 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-786ca4f6-9bdf-4b70-930a-7e8aa6d4cb58 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053420 Jun 20 14:56:49.812609 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 268/547] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 14:56:49 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 14:56:49.836514 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-84d86564-6eca-49e6-8ee7-09489fe9e080 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:49.837269 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-84d86564-6eca-49e6-8ee7-09489fe9e080 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:49.849293 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-84d86564-6eca-49e6-8ee7-09489fe9e080 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:49.850505 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-84d86564-6eca-49e6-8ee7-09489fe9e080 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:49.851706 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-84d86564-6eca-49e6-8ee7-09489fe9e080 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:49.852594 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-84d86564-6eca-49e6-8ee7-09489fe9e080 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:49.905862 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-84d86564-6eca-49e6-8ee7-09489fe9e080 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/ips" status: 200 len: 148 microversion: 2.1 time: 0.076583 Jun 20 14:56:49.906096 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e0a3e919-7567-4569-8258-29c509aec18e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:49.906600 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e0a3e919-7567-4569-8258-29c509aec18e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:49.907187 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 280/548] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 14:56:49 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/ips => generated 148 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:49.918758 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e0a3e919-7567-4569-8258-29c509aec18e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:49.919856 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e0a3e919-7567-4569-8258-29c509aec18e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:49.921648 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e0a3e919-7567-4569-8258-29c509aec18e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:49.922344 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e0a3e919-7567-4569-8258-29c509aec18e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:49.966522 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e0a3e919-7567-4569-8258-29c509aec18e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 14:56:50.088457 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e0a3e919-7567-4569-8258-29c509aec18e tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "DELETE /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 204 len: 0 microversion: 2.1 time: 0.185672 Jun 20 14:56:50.090205 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 269/549] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:56:49 2022] DELETE /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 14:56:50.100708 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-4b5b11de-4829-431f-8da7-6588c02fa412 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:50.101491 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-4b5b11de-4829-431f-8da7-6588c02fa412 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:50.113871 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4b5b11de-4829-431f-8da7-6588c02fa412 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:50.114559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4b5b11de-4829-431f-8da7-6588c02fa412 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:50.115490 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4b5b11de-4829-431f-8da7-6588c02fa412 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:50.116159 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4b5b11de-4829-431f-8da7-6588c02fa412 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:50.316753 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-4b5b11de-4829-431f-8da7-6588c02fa412 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:50.325802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-4b5b11de-4829-431f-8da7-6588c02fa412 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1690 microversion: 2.1 time: 0.231581 Jun 20 14:56:50.326413 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 281/550] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:50 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1690 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:51.345208 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-492230d1-6cbd-4cf4-a9a4-e702aaa906e9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:51.345989 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-492230d1-6cbd-4cf4-a9a4-e702aaa906e9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:51.346842 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-87a2a752-5759-4b81-a3f7-4af1c8e46da7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97e7c614-0294-4be3-9dac-7d75dd712412"}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:56:51.347965 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-87a2a752-5759-4b81-a3f7-4af1c8e46da7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:51.352756 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-492230d1-6cbd-4cf4-a9a4-e702aaa906e9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:51.353144 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-492230d1-6cbd-4cf4-a9a4-e702aaa906e9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:51.353945 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-492230d1-6cbd-4cf4-a9a4-e702aaa906e9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:51.354365 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-492230d1-6cbd-4cf4-a9a4-e702aaa906e9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:51.354483 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-87a2a752-5759-4b81-a3f7-4af1c8e46da7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:51.354945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-87a2a752-5759-4b81-a3f7-4af1c8e46da7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:51.355709 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-87a2a752-5759-4b81-a3f7-4af1c8e46da7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:51.356142 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-87a2a752-5759-4b81-a3f7-4af1c8e46da7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:51.506959 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-492230d1-6cbd-4cf4-a9a4-e702aaa906e9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:51.515192 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-492230d1-6cbd-4cf4-a9a4-e702aaa906e9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1690 microversion: 2.1 time: 0.175241 Jun 20 14:56:51.515780 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 270/551] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:51 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:52.538238 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c7811ce3-00a8-4bd9-b3a8-e8307aa2cc37 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:52.538929 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-c7811ce3-00a8-4bd9-b3a8-e8307aa2cc37 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:52.548196 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c7811ce3-00a8-4bd9-b3a8-e8307aa2cc37 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:52.548778 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c7811ce3-00a8-4bd9-b3a8-e8307aa2cc37 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:52.549809 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c7811ce3-00a8-4bd9-b3a8-e8307aa2cc37 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:52.550260 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c7811ce3-00a8-4bd9-b3a8-e8307aa2cc37 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:52.689434 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-c7811ce3-00a8-4bd9-b3a8-e8307aa2cc37 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:52.697364 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-c7811ce3-00a8-4bd9-b3a8-e8307aa2cc37 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1690 microversion: 2.1 time: 0.165174 Jun 20 14:56:52.697973 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 271/552] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:52 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:53.711749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-87a2a752-5759-4b81-a3f7-4af1c8e46da7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "POST /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.369016 Jun 20 14:56:53.717966 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 282/553] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 14:56:51 2022] POST /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments => generated 194 bytes in 2371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:53.718120 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-4a401f8d-d96c-4ea3-95e8-d5b949beb1a5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:53.718120 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-4a401f8d-d96c-4ea3-95e8-d5b949beb1a5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:53.724359 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4a401f8d-d96c-4ea3-95e8-d5b949beb1a5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:53.724702 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4a401f8d-d96c-4ea3-95e8-d5b949beb1a5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:53.725667 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4a401f8d-d96c-4ea3-95e8-d5b949beb1a5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:53.728326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4a401f8d-d96c-4ea3-95e8-d5b949beb1a5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:53.917856 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-4a401f8d-d96c-4ea3-95e8-d5b949beb1a5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:53.928228 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-4a401f8d-d96c-4ea3-95e8-d5b949beb1a5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1690 microversion: 2.1 time: 0.217024 Jun 20 14:56:53.928905 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 272/554] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:53 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1690 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:54.143279 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1d6bf513-309a-457b-9927-506265a1a108 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:54.143853 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-1d6bf513-309a-457b-9927-506265a1a108 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:54.153026 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1d6bf513-309a-457b-9927-506265a1a108 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:54.153404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1d6bf513-309a-457b-9927-506265a1a108 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:54.154197 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1d6bf513-309a-457b-9927-506265a1a108 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:54.154847 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1d6bf513-309a-457b-9927-506265a1a108 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:54.190483 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1d6bf513-309a-457b-9927-506265a1a108 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments/a6084040-1e6a-48d8-98c0-0226b875cabb" status: 200 len: 194 microversion: 2.20 time: 0.052247 Jun 20 14:56:54.191083 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 283/555] 10.222.0.23 () {60 vars in 1453 bytes} [Mon Jun 20 14:56:54 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments/a6084040-1e6a-48d8-98c0-0226b875cabb => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:56:54.266047 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b1ad884f-2899-439b-93b2-022fac3cfbcd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:54.266548 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-b1ad884f-2899-439b-93b2-022fac3cfbcd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:54.273900 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b1ad884f-2899-439b-93b2-022fac3cfbcd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:54.274353 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b1ad884f-2899-439b-93b2-022fac3cfbcd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:54.275324 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b1ad884f-2899-439b-93b2-022fac3cfbcd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:54.275791 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b1ad884f-2899-439b-93b2-022fac3cfbcd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:54.366876 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-b1ad884f-2899-439b-93b2-022fac3cfbcd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lazy-loading 'services' on Instance uuid 916159e1-4580-4bb4-a78f-857e9e15c61b {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:56:54.447970 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b1ad884f-2899-439b-93b2-022fac3cfbcd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "DELETE /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments/a6084040-1e6a-48d8-98c0-0226b875cabb" status: 202 len: 0 microversion: 2.20 time: 0.185680 Jun 20 14:56:54.452134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 273/556] 10.222.0.23 () {60 vars in 1456 bytes} [Mon Jun 20 14:56:54 2022] DELETE /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments/a6084040-1e6a-48d8-98c0-0226b875cabb => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:56:54.458464 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0586ebc4-7fda-439f-afb5-34e7a0c2e2b9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:54.459705 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-0586ebc4-7fda-439f-afb5-34e7a0c2e2b9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:54.467318 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0586ebc4-7fda-439f-afb5-34e7a0c2e2b9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:54.468269 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0586ebc4-7fda-439f-afb5-34e7a0c2e2b9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:54.469567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0586ebc4-7fda-439f-afb5-34e7a0c2e2b9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:54.474147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0586ebc4-7fda-439f-afb5-34e7a0c2e2b9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:54.514891 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0586ebc4-7fda-439f-afb5-34e7a0c2e2b9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060615 Jun 20 14:56:54.515476 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 284/557] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 14:56:54 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:56:54.784333 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-edc5cf82-1186-4be4-a326-22f28e93c7b6 req-40d0f352-f2a8-41fd-866a-45a1e1f8938e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68161747-6331-4819-a01b-24d3d5e80563", "name": "network-vif-deleted", "tag": "ba17c8d3-ed5f-4cf2-8dbe-b795150fcdf8"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:56:54.794294 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-edc5cf82-1186-4be4-a326-22f28e93c7b6 req-40d0f352-f2a8-41fd-866a-45a1e1f8938e service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:54.794800 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-edc5cf82-1186-4be4-a326-22f28e93c7b6 req-40d0f352-f2a8-41fd-866a-45a1e1f8938e service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:54.809871 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-edc5cf82-1186-4be4-a326-22f28e93c7b6 req-40d0f352-f2a8-41fd-866a-45a1e1f8938e service nova] Creating event network-vif-deleted:ba17c8d3-ed5f-4cf2-8dbe-b795150fcdf8 for instance 68161747-6331-4819-a01b-24d3d5e80563 on hv-cinder-83697 Jun 20 14:56:54.834425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-edc5cf82-1186-4be4-a326-22f28e93c7b6 req-40d0f352-f2a8-41fd-866a-45a1e1f8938e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053393 Jun 20 14:56:54.836971 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 274/558] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:56:54.947533 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d1532e20-5be8-4aef-931f-e3dccca1bf07 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:54.948146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d1532e20-5be8-4aef-931f-e3dccca1bf07 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:54.955834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d1532e20-5be8-4aef-931f-e3dccca1bf07 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:54.956520 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d1532e20-5be8-4aef-931f-e3dccca1bf07 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:54.957538 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d1532e20-5be8-4aef-931f-e3dccca1bf07 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:54.958191 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d1532e20-5be8-4aef-931f-e3dccca1bf07 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:55.001363 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d1532e20-5be8-4aef-931f-e3dccca1bf07 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:55.002028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d1532e20-5be8-4aef-931f-e3dccca1bf07 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:55.002750 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.objects.instance [None req-d1532e20-5be8-4aef-931f-e3dccca1bf07 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lazy-loading 'fault' on Instance uuid 68161747-6331-4819-a01b-24d3d5e80563 {{(pid=123979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:56:55.055052 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d1532e20-5be8-4aef-931f-e3dccca1bf07 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:55.063722 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d1532e20-5be8-4aef-931f-e3dccca1bf07 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 200 len: 1336 microversion: 2.1 time: 0.121959 Jun 20 14:56:55.064765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 285/559] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:54 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 1336 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:55.527883 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-97ff1333-26f8-4e5e-86bb-a745bd44f2d9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:55.528940 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-97ff1333-26f8-4e5e-86bb-a745bd44f2d9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:55.535549 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-97ff1333-26f8-4e5e-86bb-a745bd44f2d9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:55.535997 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-97ff1333-26f8-4e5e-86bb-a745bd44f2d9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:55.536773 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-97ff1333-26f8-4e5e-86bb-a745bd44f2d9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:55.537407 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-97ff1333-26f8-4e5e-86bb-a745bd44f2d9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:55.568628 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-97ff1333-26f8-4e5e-86bb-a745bd44f2d9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045152 Jun 20 14:56:55.569221 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 275/560] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 14:56:55 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:56:56.082574 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-63ff7fda-c858-4d3a-bc59-0e168ff3159d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:56.083244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-63ff7fda-c858-4d3a-bc59-0e168ff3159d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 68161747-6331-4819-a01b-24d3d5e80563] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:56.090254 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-63ff7fda-c858-4d3a-bc59-0e168ff3159d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:56.090705 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-63ff7fda-c858-4d3a-bc59-0e168ff3159d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:56.091477 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-63ff7fda-c858-4d3a-bc59-0e168ff3159d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:56.091916 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-63ff7fda-c858-4d3a-bc59-0e168ff3159d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:56.105882 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-63ff7fda-c858-4d3a-bc59-0e168ff3159d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] HTTP exception thrown: Instance 68161747-6331-4819-a01b-24d3d5e80563 could not be found. Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-63ff7fda-c858-4d3a-bc59-0e168ff3159d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Request method failure captured: Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 HTTP/1.1 Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImcHJuSa1U2mDQw9Je2xMgVwCoBOENl4iMW3vovpnSsB3iLV2Wky6amoiYaxxO44qc2Z72Jit4az7ijT7wcCAZNHNcWZrT6z4FDrbh0ShQZbRnswOu_dl12QuYvC9Bxopa25pVc9jmSmMGQBHZ-89TuG0RSht7skWN3u3AnyB050GU Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: 1333ac4890624e11941a2681b51b07ab Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1970379770 Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:56:56.107526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:56:56.109091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1333ac4890624e11941a2681b51b07ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1333ac4890624e11941a2681b51b07ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1333ac4890624e11941a2681b51b07ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1333ac4890624e11941a2681b51b07ab"}]}] Jun 20 14:56:56.109091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1970379770 Jun 20 14:56:56.109091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: 1333ac4890624e11941a2681b51b07ab Jun 20 14:56:56.109091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1970379770 Jun 20 14:56:56.109091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-ServerRescueNegativeTestJSON-1970379770-project Jun 20 14:56:56.109091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:56:56.109091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:56:56.109091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: afc8379be09748a68ade6af9b99cdfa2 Jun 20 14:56:56.109091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1970379770-project Jun 20 14:56:56.109091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:56:56.109091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance 68161747-6331-4819-a01b-24d3d5e80563 could not be found. Jun 20 14:56:56.109091 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '68161747-6331-4819-a01b-24d3d5e80563'} Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68161747-6331-4819-a01b-24d3d5e80563 could not be found. Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:56:56.109849 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68161747-6331-4819-a01b-24d3d5e80563 could not be found. Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68161747-6331-4819-a01b-24d3d5e80563 could not be found. Jun 20 14:56:56.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:56:56.112453 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-63ff7fda-c858-4d3a-bc59-0e168ff3159d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Returning 404 to user: Instance 68161747-6331-4819-a01b-24d3d5e80563 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:56:56.112453 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-63ff7fda-c858-4d3a-bc59-0e168ff3159d tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563" status: 404 len: 111 microversion: 2.1 time: 0.030453 Jun 20 14:56:56.112453 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 286/561] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:56 2022] GET /compute/v2.1/servers/68161747-6331-4819-a01b-24d3d5e80563 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:56:56.118589 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ef6197e7-7654-41b7-a2eb-35cf88cc598c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '.version_select at 0x7fce50976e50>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:56.139741 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ef6197e7-7654-41b7-a2eb-35cf88cc598c tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104789537" status: 202 len: 0 microversion: 2.1 time: 0.025043 Jun 20 14:56:56.140232 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 276/562] 10.222.0.23 () {58 vars in 1220 bytes} [Mon Jun 20 14:56:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104789537 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 14:56:56.580754 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-881151b1-d6e2-4eb0-aed6-0170174a554b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:56.581932 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-881151b1-d6e2-4eb0-aed6-0170174a554b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:56.592158 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-881151b1-d6e2-4eb0-aed6-0170174a554b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:56.592158 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-881151b1-d6e2-4eb0-aed6-0170174a554b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:56.592158 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-881151b1-d6e2-4eb0-aed6-0170174a554b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:56.592158 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-881151b1-d6e2-4eb0-aed6-0170174a554b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:56.625587 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-881151b1-d6e2-4eb0-aed6-0170174a554b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049098 Jun 20 14:56:56.626322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 287/563] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 14:56:56 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:56:57.639417 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1e06431c-41a2-425e-8f2c-5bc5d4744971 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:57.640364 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1e06431c-41a2-425e-8f2c-5bc5d4744971 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:57.648410 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1e06431c-41a2-425e-8f2c-5bc5d4744971 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:57.648883 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1e06431c-41a2-425e-8f2c-5bc5d4744971 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:57.649699 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1e06431c-41a2-425e-8f2c-5bc5d4744971 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:57.650083 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1e06431c-41a2-425e-8f2c-5bc5d4744971 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:57.681029 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1e06431c-41a2-425e-8f2c-5bc5d4744971 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046064 Jun 20 14:56:57.681651 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 277/564] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 14:56:57 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:56:58.699266 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-902305da-7cd8-4201-8a03-370078cffc9a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:58.700819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-902305da-7cd8-4201-8a03-370078cffc9a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:58.704039 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=4 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:58.713673 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-902305da-7cd8-4201-8a03-370078cffc9a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:58.714404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-902305da-7cd8-4201-8a03-370078cffc9a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:58.715564 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-902305da-7cd8-4201-8a03-370078cffc9a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:58.715990 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-902305da-7cd8-4201-8a03-370078cffc9a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:58.747583 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-902305da-7cd8-4201-8a03-370078cffc9a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054901 Jun 20 14:56:58.748062 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 288/565] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 14:56:58 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:56:59.333948 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-095ae9e0-554c-46d7-a636-c2810e8de382 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:59.334530 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-095ae9e0-554c-46d7-a636-c2810e8de382 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:59.342965 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-095ae9e0-554c-46d7-a636-c2810e8de382 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:59.343408 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-095ae9e0-554c-46d7-a636-c2810e8de382 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:59.344196 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-095ae9e0-554c-46d7-a636-c2810e8de382 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:59.344623 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-095ae9e0-554c-46d7-a636-c2810e8de382 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:59.369781 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-095ae9e0-554c-46d7-a636-c2810e8de382 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 14:56:59.456371 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-095ae9e0-554c-46d7-a636-c2810e8de382 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 204 len: 0 microversion: 2.1 time: 0.127360 Jun 20 14:56:59.457061 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 278/566] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:56:59 2022] DELETE /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:56:59.467015 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-5c214f7d-5768-4370-91cc-418df076c275 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:59.467629 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-5c214f7d-5768-4370-91cc-418df076c275 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:59.473823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5c214f7d-5768-4370-91cc-418df076c275 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:59.474283 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5c214f7d-5768-4370-91cc-418df076c275 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:59.475046 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5c214f7d-5768-4370-91cc-418df076c275 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:59.475484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5c214f7d-5768-4370-91cc-418df076c275 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:59.608084 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-5c214f7d-5768-4370-91cc-418df076c275 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:56:59.615959 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-5c214f7d-5768-4370-91cc-418df076c275 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1509 microversion: 2.1 time: 0.153361 Jun 20 14:56:59.616573 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 289/567] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:56:59 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:56:59.760253 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c5cae54c-711b-4f2d-baf6-0eadcd7c48ee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:56:59.761273 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-c5cae54c-711b-4f2d-baf6-0eadcd7c48ee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:56:59.767388 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c5cae54c-711b-4f2d-baf6-0eadcd7c48ee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:59.767822 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c5cae54c-711b-4f2d-baf6-0eadcd7c48ee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:59.768559 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c5cae54c-711b-4f2d-baf6-0eadcd7c48ee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:56:59.769021 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c5cae54c-711b-4f2d-baf6-0eadcd7c48ee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:56:59.798588 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-c5cae54c-711b-4f2d-baf6-0eadcd7c48ee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042811 Jun 20 14:56:59.799160 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 279/568] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 14:56:59 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:57:00.637457 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-058667e2-4d3e-4835-ad8f-84ba2f2ee1bc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:00.638805 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-058667e2-4d3e-4835-ad8f-84ba2f2ee1bc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:00.650022 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-058667e2-4d3e-4835-ad8f-84ba2f2ee1bc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:00.650790 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-058667e2-4d3e-4835-ad8f-84ba2f2ee1bc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:00.652061 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-058667e2-4d3e-4835-ad8f-84ba2f2ee1bc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:00.652780 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-058667e2-4d3e-4835-ad8f-84ba2f2ee1bc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:00.787120 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-058667e2-4d3e-4835-ad8f-84ba2f2ee1bc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:00.794720 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-058667e2-4d3e-4835-ad8f-84ba2f2ee1bc tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1509 microversion: 2.1 time: 0.163982 Jun 20 14:57:00.795289 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 290/569] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:00 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:00.810876 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-770048c1-6fa1-404e-854e-94ebdcb2c721 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:00.812160 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-770048c1-6fa1-404e-854e-94ebdcb2c721 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:00.818613 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-770048c1-6fa1-404e-854e-94ebdcb2c721 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:00.819050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-770048c1-6fa1-404e-854e-94ebdcb2c721 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:00.819810 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-770048c1-6fa1-404e-854e-94ebdcb2c721 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:00.820216 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-770048c1-6fa1-404e-854e-94ebdcb2c721 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:00.837928 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:00.853882 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-770048c1-6fa1-404e-854e-94ebdcb2c721 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047368 Jun 20 14:57:00.854435 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 280/570] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 14:57:00 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:57:01.812194 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-20081f3c-bfef-448f-a7e6-2f58ad2a0804 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:01.812825 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-20081f3c-bfef-448f-a7e6-2f58ad2a0804 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:01.819826 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-20081f3c-bfef-448f-a7e6-2f58ad2a0804 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:01.820276 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-20081f3c-bfef-448f-a7e6-2f58ad2a0804 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:01.821084 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-20081f3c-bfef-448f-a7e6-2f58ad2a0804 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:01.821517 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-20081f3c-bfef-448f-a7e6-2f58ad2a0804 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:01.866638 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e554af25-eb58-45a8-a719-09a9c953a46d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:01.867590 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e554af25-eb58-45a8-a719-09a9c953a46d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:01.874946 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e554af25-eb58-45a8-a719-09a9c953a46d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:01.875388 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e554af25-eb58-45a8-a719-09a9c953a46d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:01.876148 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e554af25-eb58-45a8-a719-09a9c953a46d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:01.876576 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e554af25-eb58-45a8-a719-09a9c953a46d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:01.906201 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e554af25-eb58-45a8-a719-09a9c953a46d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043659 Jun 20 14:57:01.906753 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 281/571] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 14:57:01 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:57:01.951428 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-20081f3c-bfef-448f-a7e6-2f58ad2a0804 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:01.959802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-20081f3c-bfef-448f-a7e6-2f58ad2a0804 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1509 microversion: 2.1 time: 0.152107 Jun 20 14:57:01.960373 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 291/572] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:01 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:02.919791 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7946516b-acba-4381-bf02-30e4e4094b4d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:02.921106 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7946516b-acba-4381-bf02-30e4e4094b4d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:02.928418 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7946516b-acba-4381-bf02-30e4e4094b4d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:02.929209 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7946516b-acba-4381-bf02-30e4e4094b4d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:02.930194 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7946516b-acba-4381-bf02-30e4e4094b4d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:02.931173 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7946516b-acba-4381-bf02-30e4e4094b4d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:02.963520 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7946516b-acba-4381-bf02-30e4e4094b4d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048753 Jun 20 14:57:02.964190 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 282/573] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 14:57:02 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 14:57:02.977887 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-34c29759-b13b-4d2d-b380-c5c1ceb64f23 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:02.978667 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-34c29759-b13b-4d2d-b380-c5c1ceb64f23 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:02.991155 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-34c29759-b13b-4d2d-b380-c5c1ceb64f23 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:02.991621 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-34c29759-b13b-4d2d-b380-c5c1ceb64f23 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:02.992446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-34c29759-b13b-4d2d-b380-c5c1ceb64f23 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:02.992917 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-34c29759-b13b-4d2d-b380-c5c1ceb64f23 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:03.083802 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-fc671eda-ea26-429c-8f74-0893eb005121 req-1b9ec72e-21f7-4044-9417-3d904dc96df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d88e00c-10bb-48b8-a343-827831f04e10", "name": "network-vif-deleted", "tag": "0932c295-9cbf-4b3f-aa7d-967d7d8030f1"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:03.092662 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-fc671eda-ea26-429c-8f74-0893eb005121 req-1b9ec72e-21f7-4044-9417-3d904dc96df0 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:03.093428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-fc671eda-ea26-429c-8f74-0893eb005121 req-1b9ec72e-21f7-4044-9417-3d904dc96df0 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:03.106313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-fc671eda-ea26-429c-8f74-0893eb005121 req-1b9ec72e-21f7-4044-9417-3d904dc96df0 service nova] Creating event network-vif-deleted:0932c295-9cbf-4b3f-aa7d-967d7d8030f1 for instance 5d88e00c-10bb-48b8-a343-827831f04e10 on hv-cinder-83697 Jun 20 14:57:03.111372 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-fc671eda-ea26-429c-8f74-0893eb005121 req-1b9ec72e-21f7-4044-9417-3d904dc96df0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031179 Jun 20 14:57:03.112618 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 283/574] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:03.195505 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-34c29759-b13b-4d2d-b380-c5c1ceb64f23 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:03.203593 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-34c29759-b13b-4d2d-b380-c5c1ceb64f23 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 200 len: 1467 microversion: 2.1 time: 0.230298 Jun 20 14:57:03.204175 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 292/575] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:02 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 1467 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:03.431422 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1223881681", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2098402945", "security_groups": [{"name": "tempest-secgroup-smoke-1201977844"}], "block_device_mapping_v2": [{"uuid": "5a0ec395-b042-46d3-aec4-bd2e913ed4f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7c7b0d7e-13ae-4804-adde-4f7659f4fca5"}]}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:03.455986 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-075c86eb-117d-4834-a47a-b6d5ad406a54 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97e7c614-0294-4be3-9dac-7d75dd712412"}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:03.457155 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-075c86eb-117d-4834-a47a-b6d5ad406a54 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:03.472815 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-075c86eb-117d-4834-a47a-b6d5ad406a54 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:03.473270 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-075c86eb-117d-4834-a47a-b6d5ad406a54 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:03.474044 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-075c86eb-117d-4834-a47a-b6d5ad406a54 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:03.474685 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-075c86eb-117d-4834-a47a-b6d5ad406a54 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:03.582860 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-075c86eb-117d-4834-a47a-b6d5ad406a54 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] HTTP exception thrown: Invalid volume: volume 97e7c614-0294-4be3-9dac-7d75dd712412 is already attached to instances: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-075c86eb-117d-4834-a47a-b6d5ad406a54 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Request method failure captured: Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: POST /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments HTTP/1.1 Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 74 Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImbz0WxD1k9ycjcFtONQioapmstd9ALeY-XOY9KWzwZRC4BzRHKOJNKseVz_SOU8X1kqkeZceHCAJurCXmzp5osSOaO2_Ehpi_atwxfvtaZZDfF13_WZ-v9TPM1dlOrXp8wu-OjE4ErE1kdNfUTWsTDESJSRneLOLv_h39cbJpuqhQ Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:57:03.584569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:57:03.586027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}] Jun 20 14:57:03.586027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:57:03.586027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:57:03.586027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:57:03.586027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:57:03.586027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:57:03.586027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:57:03.586027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 87c3f39c0bed4fadbc8a556c857baf4a Jun 20 14:57:03.586027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:57:03.586027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Jun 20 14:57:03.586027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {"volumeAttachment": {"volumeId": "97e7c614-0294-4be3-9dac-7d75dd712412"}} Jun 20 14:57:03.586027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Invalid volume: volume 97e7c614-0294-4be3-9dac-7d75dd712412 is already attached to instances: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'server_id': '4dc2b001-2afc-4387-bc75-f9a40d79d9ac', 'body': {'volumeAttachment': {'volumeId': '97e7c614-0294-4be3-9dac-7d75dd712412'}}} Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 97e7c614-0294-4be3-9dac-7d75dd712412 is already attached to instances: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:57:03.586799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 97e7c614-0294-4be3-9dac-7d75dd712412 is already attached to instances: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:57:03.588002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:57:03.589323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:57:03.589323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:57:03.589323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:57:03.589323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 97e7c614-0294-4be3-9dac-7d75dd712412 is already attached to instances: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac Jun 20 14:57:03.589323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:57:03.589323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-075c86eb-117d-4834-a47a-b6d5ad406a54 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Returning 400 to user: Invalid volume: volume 97e7c614-0294-4be3-9dac-7d75dd712412 is already attached to instances: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:57:03.589323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-075c86eb-117d-4834-a47a-b6d5ad406a54 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "POST /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.136439 Jun 20 14:57:03.596339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 293/576] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 14:57:03 2022] POST /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 14:57:03.657782 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-89abf3c2-3c42-427f-9b92-f04bf86158b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:03.658272 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-89abf3c2-3c42-427f-9b92-f04bf86158b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:03.664652 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-89abf3c2-3c42-427f-9b92-f04bf86158b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:03.665184 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-89abf3c2-3c42-427f-9b92-f04bf86158b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:03.666006 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-89abf3c2-3c42-427f-9b92-f04bf86158b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:03.666522 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-89abf3c2-3c42-427f-9b92-f04bf86158b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:03.729237 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.network.neutron [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] validate_networks() for [('7c7b0d7e-13ae-4804-adde-4f7659f4fca5', None, None, None, None, None)] {{(pid=123978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:57:03.744277 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:03.748180 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.objects.instance [None req-89abf3c2-3c42-427f-9b92-f04bf86158b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lazy-loading 'services' on Instance uuid 4dc2b001-2afc-4387-bc75-f9a40d79d9ac {{(pid=123979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:57:03.825907 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-89abf3c2-3c42-427f-9b92-f04bf86158b8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments/97e7c614-0294-4be3-9dac-7d75dd712412" status: 202 len: 0 microversion: 2.1 time: 0.172002 Jun 20 14:57:03.826522 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 294/577] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 14:57:03 2022] DELETE /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments/97e7c614-0294-4be3-9dac-7d75dd712412 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 14:57:03.835518 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-f9140e4e-fee3-426e-b9de-d5b16ccc5e53 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:03.836514 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-f9140e4e-fee3-426e-b9de-d5b16ccc5e53 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:03.842913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f9140e4e-fee3-426e-b9de-d5b16ccc5e53 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:03.843294 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f9140e4e-fee3-426e-b9de-d5b16ccc5e53 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:03.844097 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f9140e4e-fee3-426e-b9de-d5b16ccc5e53 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:03.844578 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f9140e4e-fee3-426e-b9de-d5b16ccc5e53 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:03.884264 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-f9140e4e-fee3-426e-b9de-d5b16ccc5e53 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052907 Jun 20 14:57:03.884977 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 295/578] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 14:57:03 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 14:57:03.975456 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-afebd01d-869b-4782-ab1d-3480ad2d2cc8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:03.976368 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-afebd01d-869b-4782-ab1d-3480ad2d2cc8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:03.983449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-afebd01d-869b-4782-ab1d-3480ad2d2cc8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:03.984100 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-afebd01d-869b-4782-ab1d-3480ad2d2cc8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:03.984619 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-afebd01d-869b-4782-ab1d-3480ad2d2cc8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:03.985379 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-afebd01d-869b-4782-ab1d-3480ad2d2cc8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:04.015966 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-afebd01d-869b-4782-ab1d-3480ad2d2cc8 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044429 Jun 20 14:57:04.016771 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 296/579] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 14:57:03 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:57:04.073458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-44b29b51-1d33-4d43-8908-ef5e1430cafb tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:04.073949 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-44b29b51-1d33-4d43-8908-ef5e1430cafb tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:04.080794 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-44b29b51-1d33-4d43-8908-ef5e1430cafb tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:04.081247 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-44b29b51-1d33-4d43-8908-ef5e1430cafb tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:04.082007 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-44b29b51-1d33-4d43-8908-ef5e1430cafb tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:04.083079 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-44b29b51-1d33-4d43-8908-ef5e1430cafb tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:04.110344 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-44b29b51-1d33-4d43-8908-ef5e1430cafb tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Going to try to terminate instance {{(pid=123979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 14:57:04.113383 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Flavor limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:57:04.113867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Image limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:57:04.114393 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Flavor pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:57:04.114875 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Image pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:57:04.115341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:57:04.126690 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:04.127226 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:04.128012 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:04.128438 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:04.145402 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Getting quotas for project c4515b09c1944036b62a40cc5e88719e. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:57:04.150024 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Getting quotas for user 3876008710b8469c9f65a24789a58067 and project c4515b09c1944036b62a40cc5e88719e. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:57:04.210088 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-44b29b51-1d33-4d43-8908-ef5e1430cafb tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "DELETE /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 204 len: 0 microversion: 2.20 time: 0.140248 Jun 20 14:57:04.211293 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 297/580] 10.222.0.23 () {60 vars in 1279 bytes} [Mon Jun 20 14:57:04 2022] DELETE /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 14:57:04.219837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9df17c1d-40e7-449a-9e14-fc533cf515e2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:04.220527 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9df17c1d-40e7-449a-9e14-fc533cf515e2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:04.224594 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Going to run 1 instances... {{(pid=123978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:57:04.227299 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a0ec395-b042-46d3-aec4-bd2e913ed4f1',volume_size=None,volume_type=None)] {{(pid=123978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:57:04.227833 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9df17c1d-40e7-449a-9e14-fc533cf515e2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:04.228339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9df17c1d-40e7-449a-9e14-fc533cf515e2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:04.229239 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9df17c1d-40e7-449a-9e14-fc533cf515e2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:04.229754 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9df17c1d-40e7-449a-9e14-fc533cf515e2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:04.359925 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [0a7ad114-31e9-433a-b103-58408d147281] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 14:57:04.362543 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9df17c1d-40e7-449a-9e14-fc533cf515e2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:04.370800 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9df17c1d-40e7-449a-9e14-fc533cf515e2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:04.372304 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9df17c1d-40e7-449a-9e14-fc533cf515e2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:04.373588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9df17c1d-40e7-449a-9e14-fc533cf515e2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.158352 Jun 20 14:57:04.374202 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 298/581] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:04 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:57:04.378696 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9e6d9ba9-bd3f-4345-b636-c2d30bff9fd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:04.379482 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9e6d9ba9-bd3f-4345-b636-c2d30bff9fd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 5d88e00c-10bb-48b8-a343-827831f04e10] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:04.385614 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9e6d9ba9-bd3f-4345-b636-c2d30bff9fd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:04.386060 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9e6d9ba9-bd3f-4345-b636-c2d30bff9fd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:04.386822 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9e6d9ba9-bd3f-4345-b636-c2d30bff9fd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:04.387258 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9e6d9ba9-bd3f-4345-b636-c2d30bff9fd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:04.400809 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-9e6d9ba9-bd3f-4345-b636-c2d30bff9fd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] HTTP exception thrown: Instance 5d88e00c-10bb-48b8-a343-827831f04e10 could not be found. Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9e6d9ba9-bd3f-4345-b636-c2d30bff9fd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Request method failure captured: Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 HTTP/1.1 Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImcHJuSa1U2mDQw9Je2xMgVwCoBOENl4iMW3vovpnSsB3iLV2Wky6amoiYaxxO44qc2Z72Jit4az7ijT7wcCAZNHNcWZrT6z4FDrbh0ShQZbRnswOu_dl12QuYvC9Bxopa25pVc9jmSmMGQBHZ-89TuG0RSht7skWN3u3AnyB050GU Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: 1333ac4890624e11941a2681b51b07ab Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1970379770 Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:57:04.402468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:57:04.404028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1333ac4890624e11941a2681b51b07ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1333ac4890624e11941a2681b51b07ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1333ac4890624e11941a2681b51b07ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1333ac4890624e11941a2681b51b07ab"}]}] Jun 20 14:57:04.404028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1970379770 Jun 20 14:57:04.404028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: 1333ac4890624e11941a2681b51b07ab Jun 20 14:57:04.404028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1970379770 Jun 20 14:57:04.404028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-ServerRescueNegativeTestJSON-1970379770-project Jun 20 14:57:04.404028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:57:04.404028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:57:04.404028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: afc8379be09748a68ade6af9b99cdfa2 Jun 20 14:57:04.404028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1970379770-project Jun 20 14:57:04.404028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:57:04.404028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance 5d88e00c-10bb-48b8-a343-827831f04e10 could not be found. Jun 20 14:57:04.404028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '5d88e00c-10bb-48b8-a343-827831f04e10'} Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d88e00c-10bb-48b8-a343-827831f04e10 could not be found. Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:57:04.408047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d88e00c-10bb-48b8-a343-827831f04e10 could not be found. Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d88e00c-10bb-48b8-a343-827831f04e10 could not be found. Jun 20 14:57:04.409510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:57:04.410794 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9e6d9ba9-bd3f-4345-b636-c2d30bff9fd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Returning 404 to user: Instance 5d88e00c-10bb-48b8-a343-827831f04e10 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:57:04.410794 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9e6d9ba9-bd3f-4345-b636-c2d30bff9fd8 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10" status: 404 len: 111 microversion: 2.1 time: 0.028763 Jun 20 14:57:04.410794 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 299/582] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:04 2022] GET /compute/v2.1/servers/5d88e00c-10bb-48b8-a343-827831f04e10 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:57:04.413420 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-5fff00ce-43ad-4d07-9619-739d065ef2c0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:04.413909 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-5fff00ce-43ad-4d07-9619-739d065ef2c0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:04.419813 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5fff00ce-43ad-4d07-9619-739d065ef2c0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:04.420254 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5fff00ce-43ad-4d07-9619-739d065ef2c0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:04.421132 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5fff00ce-43ad-4d07-9619-739d065ef2c0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:04.421562 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5fff00ce-43ad-4d07-9619-739d065ef2c0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:04.446708 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-5fff00ce-43ad-4d07-9619-739d065ef2c0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Going to try to terminate instance {{(pid=123979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 14:57:04.526336 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-5fff00ce-43ad-4d07-9619-739d065ef2c0 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "DELETE /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 204 len: 0 microversion: 2.1 time: 0.116237 Jun 20 14:57:04.526892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 300/583] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:57:04 2022] DELETE /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:57:04.535111 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-293aef5c-957e-4f5a-937f-e32462ef42ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:04.535808 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-293aef5c-957e-4f5a-937f-e32462ef42ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:04.541433 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-293aef5c-957e-4f5a-937f-e32462ef42ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:04.541876 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-293aef5c-957e-4f5a-937f-e32462ef42ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:04.542669 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-293aef5c-957e-4f5a-937f-e32462ef42ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:04.543089 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-293aef5c-957e-4f5a-937f-e32462ef42ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:04.681817 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-293aef5c-957e-4f5a-937f-e32462ef42ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:04.694247 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-293aef5c-957e-4f5a-937f-e32462ef42ba tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 0.162725 Jun 20 14:57:04.694969 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 301/584] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:04 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:57:04.899219 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-61519f2a-70b4-4fef-ad98-6b7d218aeb99 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:04.900588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-61519f2a-70b4-4fef-ad98-6b7d218aeb99 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:04.910651 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-61519f2a-70b4-4fef-ad98-6b7d218aeb99 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:04.911335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-61519f2a-70b4-4fef-ad98-6b7d218aeb99 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:04.912498 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-61519f2a-70b4-4fef-ad98-6b7d218aeb99 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:04.913202 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-61519f2a-70b4-4fef-ad98-6b7d218aeb99 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:04.948269 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-61519f2a-70b4-4fef-ad98-6b7d218aeb99 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055340 Jun 20 14:57:04.948900 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 302/585] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 14:57:04 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:05.372364 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO oslo.messaging._drivers.impl_rabbit [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [0a7ad114-31e9-433a-b103-58408d147281] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 54732. Jun 20 14:57:05.377804 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f5aac0d6-8868-4266-ba9f-30c8791c0656 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.950570 Jun 20 14:57:05.378458 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 284/586] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 14:57:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 14:57:05.388675 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-473b0d2a-f0bf-43b3-883d-dcdb3c19e4bb tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:05.389435 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-473b0d2a-f0bf-43b3-883d-dcdb3c19e4bb tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:05.393795 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3f7647a0-0438-40ef-b4d6-c2127a2c9492 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:05.394539 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-3f7647a0-0438-40ef-b4d6-c2127a2c9492 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:05.404436 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3f7647a0-0438-40ef-b4d6-c2127a2c9492 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:05.404911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3f7647a0-0438-40ef-b4d6-c2127a2c9492 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:05.405685 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3f7647a0-0438-40ef-b4d6-c2127a2c9492 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:05.406111 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3f7647a0-0438-40ef-b4d6-c2127a2c9492 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:05.455823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-473b0d2a-f0bf-43b3-883d-dcdb3c19e4bb tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:05.462564 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-473b0d2a-f0bf-43b3-883d-dcdb3c19e4bb tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1095 microversion: 2.1 time: 0.077716 Jun 20 14:57:05.472041 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 303/587] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:05 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1095 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:05.565282 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3f7647a0-0438-40ef-b4d6-c2127a2c9492 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:05.573226 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3f7647a0-0438-40ef-b4d6-c2127a2c9492 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:05.574735 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3f7647a0-0438-40ef-b4d6-c2127a2c9492 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:05.575887 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-3f7647a0-0438-40ef-b4d6-c2127a2c9492 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.186890 Jun 20 14:57:05.576439 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 285/588] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:05 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:57:05.711513 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-980e9a3c-a94d-4c49-a466-a98ba68ba4b5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:05.712117 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-980e9a3c-a94d-4c49-a466-a98ba68ba4b5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:05.719274 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-980e9a3c-a94d-4c49-a466-a98ba68ba4b5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:05.719714 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-980e9a3c-a94d-4c49-a466-a98ba68ba4b5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:05.720472 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-980e9a3c-a94d-4c49-a466-a98ba68ba4b5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:05.720949 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-980e9a3c-a94d-4c49-a466-a98ba68ba4b5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:05.853269 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-980e9a3c-a94d-4c49-a466-a98ba68ba4b5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:05.861077 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-980e9a3c-a94d-4c49-a466-a98ba68ba4b5 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 0.153548 Jun 20 14:57:05.861639 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 304/589] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:05 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:05.963477 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-22cb54c1-1c06-4f7d-bde4-ddfb99870741 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:05.964937 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-22cb54c1-1c06-4f7d-bde4-ddfb99870741 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:05.972920 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-22cb54c1-1c06-4f7d-bde4-ddfb99870741 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:05.973366 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-22cb54c1-1c06-4f7d-bde4-ddfb99870741 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:05.974124 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-22cb54c1-1c06-4f7d-bde4-ddfb99870741 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:05.974556 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-22cb54c1-1c06-4f7d-bde4-ddfb99870741 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:06.006543 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-22cb54c1-1c06-4f7d-bde4-ddfb99870741 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049395 Jun 20 14:57:06.007148 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 286/590] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 14:57:05 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:06.481318 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d49ca551-002f-47e9-827b-c9a68e5022cf tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:06.482011 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d49ca551-002f-47e9-827b-c9a68e5022cf tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:06.489519 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d49ca551-002f-47e9-827b-c9a68e5022cf tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:06.489968 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d49ca551-002f-47e9-827b-c9a68e5022cf tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:06.490732 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d49ca551-002f-47e9-827b-c9a68e5022cf tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:06.491157 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d49ca551-002f-47e9-827b-c9a68e5022cf tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:06.556421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d49ca551-002f-47e9-827b-c9a68e5022cf tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:06.566245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d49ca551-002f-47e9-827b-c9a68e5022cf tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1145 microversion: 2.1 time: 0.089962 Jun 20 14:57:06.566792 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 305/591] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:06 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:06.595897 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-415b5890-7e9f-4e1a-a129-7c21cd601d8e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:06.596478 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-415b5890-7e9f-4e1a-a129-7c21cd601d8e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:06.602997 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-415b5890-7e9f-4e1a-a129-7c21cd601d8e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:06.603443 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-415b5890-7e9f-4e1a-a129-7c21cd601d8e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:06.604208 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-415b5890-7e9f-4e1a-a129-7c21cd601d8e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:06.604635 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-415b5890-7e9f-4e1a-a129-7c21cd601d8e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:06.741722 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-415b5890-7e9f-4e1a-a129-7c21cd601d8e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:06.750175 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-415b5890-7e9f-4e1a-a129-7c21cd601d8e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:06.751670 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-415b5890-7e9f-4e1a-a129-7c21cd601d8e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:06.752856 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-415b5890-7e9f-4e1a-a129-7c21cd601d8e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.162119 Jun 20 14:57:06.753420 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 287/592] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:06 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:57:06.882026 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-62eb10bb-37d9-42fb-81c2-67b2116bbcb4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:06.883029 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-62eb10bb-37d9-42fb-81c2-67b2116bbcb4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:06.892377 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-62eb10bb-37d9-42fb-81c2-67b2116bbcb4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:06.892851 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-62eb10bb-37d9-42fb-81c2-67b2116bbcb4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:06.893587 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-62eb10bb-37d9-42fb-81c2-67b2116bbcb4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:06.894035 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-62eb10bb-37d9-42fb-81c2-67b2116bbcb4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:07.018847 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-a31cbd16-d39a-43a5-913a-28e9d5a0fff7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:07.019799 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-a31cbd16-d39a-43a5-913a-28e9d5a0fff7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:07.027608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a31cbd16-d39a-43a5-913a-28e9d5a0fff7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:07.028002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-62eb10bb-37d9-42fb-81c2-67b2116bbcb4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:07.028171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a31cbd16-d39a-43a5-913a-28e9d5a0fff7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:07.028802 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a31cbd16-d39a-43a5-913a-28e9d5a0fff7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:07.029258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a31cbd16-d39a-43a5-913a-28e9d5a0fff7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:07.035818 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-62eb10bb-37d9-42fb-81c2-67b2116bbcb4 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 0.160415 Jun 20 14:57:07.036418 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 306/593] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:06 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:07.058762 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-a31cbd16-d39a-43a5-913a-28e9d5a0fff7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Jun 20 14:57:07.059360 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 288/594] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 14:57:07 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:07.587391 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7553510f-c658-4ea3-9fde-8b82d213b68f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:07.588441 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7553510f-c658-4ea3-9fde-8b82d213b68f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:07.597140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7553510f-c658-4ea3-9fde-8b82d213b68f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:07.597586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7553510f-c658-4ea3-9fde-8b82d213b68f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:07.598340 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7553510f-c658-4ea3-9fde-8b82d213b68f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:07.598764 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7553510f-c658-4ea3-9fde-8b82d213b68f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:07.659534 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7553510f-c658-4ea3-9fde-8b82d213b68f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:07.667513 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7553510f-c658-4ea3-9fde-8b82d213b68f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1145 microversion: 2.1 time: 0.086533 Jun 20 14:57:07.668075 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 307/595] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:07 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:07.774903 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-59146097-386f-41aa-9926-c2fa37899958 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:07.775875 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-59146097-386f-41aa-9926-c2fa37899958 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:07.786148 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-59146097-386f-41aa-9926-c2fa37899958 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:07.786879 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-59146097-386f-41aa-9926-c2fa37899958 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:07.788119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-59146097-386f-41aa-9926-c2fa37899958 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:07.788867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-59146097-386f-41aa-9926-c2fa37899958 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:07.926897 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-59146097-386f-41aa-9926-c2fa37899958 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:07.939771 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-59146097-386f-41aa-9926-c2fa37899958 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:07.942166 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-59146097-386f-41aa-9926-c2fa37899958 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:07.943963 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-59146097-386f-41aa-9926-c2fa37899958 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.175283 Jun 20 14:57:07.944791 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 289/596] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:07 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:57:08.053103 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-72686d3a-fa18-47b2-8424-cdc5cd0f53f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:08.053702 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-72686d3a-fa18-47b2-8424-cdc5cd0f53f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:08.060203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-72686d3a-fa18-47b2-8424-cdc5cd0f53f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:08.060641 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-72686d3a-fa18-47b2-8424-cdc5cd0f53f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:08.061780 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-72686d3a-fa18-47b2-8424-cdc5cd0f53f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:08.062210 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-72686d3a-fa18-47b2-8424-cdc5cd0f53f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:08.070941 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-a1e39da7-33a1-4a62-8921-763345ffd3ed tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:08.071900 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-a1e39da7-33a1-4a62-8921-763345ffd3ed tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:08.079105 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a1e39da7-33a1-4a62-8921-763345ffd3ed tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:08.079538 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a1e39da7-33a1-4a62-8921-763345ffd3ed tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:08.080300 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a1e39da7-33a1-4a62-8921-763345ffd3ed tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:08.080758 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a1e39da7-33a1-4a62-8921-763345ffd3ed tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:08.111776 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-a1e39da7-33a1-4a62-8921-763345ffd3ed tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044838 Jun 20 14:57:08.112503 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 290/597] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 14:57:08 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:08.192001 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-72686d3a-fa18-47b2-8424-cdc5cd0f53f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:08.200106 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-72686d3a-fa18-47b2-8424-cdc5cd0f53f9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1522 microversion: 2.1 time: 0.150997 Jun 20 14:57:08.200643 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 308/598] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:08 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:08.683801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-816a3b0d-7c00-416e-998a-49bef7def1fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:08.684426 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-816a3b0d-7c00-416e-998a-49bef7def1fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:08.691340 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-816a3b0d-7c00-416e-998a-49bef7def1fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:08.692079 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-816a3b0d-7c00-416e-998a-49bef7def1fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:08.692565 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-816a3b0d-7c00-416e-998a-49bef7def1fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:08.693290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-816a3b0d-7c00-416e-998a-49bef7def1fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:08.796960 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-816a3b0d-7c00-416e-998a-49bef7def1fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:08.807002 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-816a3b0d-7c00-416e-998a-49bef7def1fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1193 microversion: 2.1 time: 0.127128 Jun 20 14:57:08.809346 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 291/599] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:08 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1193 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:08.962972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-fdfe9a0e-98a9-48d8-8ea9-46ed4ac918a2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:08.964287 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-fdfe9a0e-98a9-48d8-8ea9-46ed4ac918a2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:08.971913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fdfe9a0e-98a9-48d8-8ea9-46ed4ac918a2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:08.972729 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fdfe9a0e-98a9-48d8-8ea9-46ed4ac918a2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:08.973820 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fdfe9a0e-98a9-48d8-8ea9-46ed4ac918a2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:08.974786 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fdfe9a0e-98a9-48d8-8ea9-46ed4ac918a2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:09.001002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:09.125580 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3b1c9336-c2f1-443e-ac6c-6fa257d084eb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:09.128505 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-3b1c9336-c2f1-443e-ac6c-6fa257d084eb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:09.139682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3b1c9336-c2f1-443e-ac6c-6fa257d084eb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:09.140618 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3b1c9336-c2f1-443e-ac6c-6fa257d084eb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:09.142039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3b1c9336-c2f1-443e-ac6c-6fa257d084eb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:09.142712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3b1c9336-c2f1-443e-ac6c-6fa257d084eb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:09.182415 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-3b1c9336-c2f1-443e-ac6c-6fa257d084eb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062370 Jun 20 14:57:09.189584 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 292/600] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 14:57:09 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 14:57:09.217513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-78d263f5-6954-4953-a502-66b44fd830a9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:09.218434 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-78d263f5-6954-4953-a502-66b44fd830a9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:09.227372 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-78d263f5-6954-4953-a502-66b44fd830a9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:09.228858 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-78d263f5-6954-4953-a502-66b44fd830a9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:09.229909 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-78d263f5-6954-4953-a502-66b44fd830a9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:09.231520 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-78d263f5-6954-4953-a502-66b44fd830a9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:09.381778 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-78d263f5-6954-4953-a502-66b44fd830a9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:09.390431 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-78d263f5-6954-4953-a502-66b44fd830a9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1480 microversion: 2.1 time: 0.177172 Jun 20 14:57:09.393991 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 293/601] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:09 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1480 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:57:09.407528 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6eee457d-c98c-45f7-b29a-8d6e449ba51d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:09.408020 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6eee457d-c98c-45f7-b29a-8d6e449ba51d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:09.415487 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6eee457d-c98c-45f7-b29a-8d6e449ba51d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:09.416305 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6eee457d-c98c-45f7-b29a-8d6e449ba51d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:09.417338 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6eee457d-c98c-45f7-b29a-8d6e449ba51d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:09.417974 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6eee457d-c98c-45f7-b29a-8d6e449ba51d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:09.464288 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6eee457d-c98c-45f7-b29a-8d6e449ba51d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 14:57:09.513176 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-fdfe9a0e-98a9-48d8-8ea9-46ed4ac918a2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:09.525458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-fdfe9a0e-98a9-48d8-8ea9-46ed4ac918a2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:09.526860 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-fdfe9a0e-98a9-48d8-8ea9-46ed4ac918a2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:09.528019 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-fdfe9a0e-98a9-48d8-8ea9-46ed4ac918a2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1725 microversion: 2.20 time: 0.569124 Jun 20 14:57:09.528575 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 309/602] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:08 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1725 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:57:09.534498 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-d8b0a681-eb77-4026-85ae-b2ad87881324 req-709181ea-dd52-4e2c-8a38-8fc2dfa5538b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80267d79-170a-4c4e-b7fe-dfff49c7f195", "name": "network-vif-deleted", "tag": "baa0872d-d472-425e-bc75-cdef4f527e6e"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:09.555466 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-d8b0a681-eb77-4026-85ae-b2ad87881324 req-709181ea-dd52-4e2c-8a38-8fc2dfa5538b service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:09.556869 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-d8b0a681-eb77-4026-85ae-b2ad87881324 req-709181ea-dd52-4e2c-8a38-8fc2dfa5538b service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:09.577951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-d8b0a681-eb77-4026-85ae-b2ad87881324 req-709181ea-dd52-4e2c-8a38-8fc2dfa5538b service nova] Creating event network-vif-deleted:baa0872d-d472-425e-bc75-cdef4f527e6e for instance 80267d79-170a-4c4e-b7fe-dfff49c7f195 on hv-cinder-83697 Jun 20 14:57:09.583872 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-d8b0a681-eb77-4026-85ae-b2ad87881324 req-709181ea-dd52-4e2c-8a38-8fc2dfa5538b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052791 Jun 20 14:57:09.584854 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 310/603] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:09.590357 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6eee457d-c98c-45f7-b29a-8d6e449ba51d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 204 len: 0 microversion: 2.1 time: 0.194045 Jun 20 14:57:09.591103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 294/604] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:57:09 2022] DELETE /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:57:09.599766 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-37b1fc83-de31-439f-bda3-49fb2cec2dc0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:09.600517 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-37b1fc83-de31-439f-bda3-49fb2cec2dc0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:09.607159 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-37b1fc83-de31-439f-bda3-49fb2cec2dc0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:09.607625 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-37b1fc83-de31-439f-bda3-49fb2cec2dc0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:09.608384 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-37b1fc83-de31-439f-bda3-49fb2cec2dc0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:09.608873 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-37b1fc83-de31-439f-bda3-49fb2cec2dc0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:09.805559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-37b1fc83-de31-439f-bda3-49fb2cec2dc0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:09.816561 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-37b1fc83-de31-439f-bda3-49fb2cec2dc0 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1679 microversion: 2.1 time: 0.220845 Jun 20 14:57:09.827468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 311/605] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:09 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1679 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:09.833602 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-dc3c3fc2-1300-4024-b5c9-7b5f0902a62a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:09.834516 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-dc3c3fc2-1300-4024-b5c9-7b5f0902a62a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:09.840849 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dc3c3fc2-1300-4024-b5c9-7b5f0902a62a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:09.841288 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dc3c3fc2-1300-4024-b5c9-7b5f0902a62a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:09.842041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dc3c3fc2-1300-4024-b5c9-7b5f0902a62a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:09.844010 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dc3c3fc2-1300-4024-b5c9-7b5f0902a62a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:09.932146 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-dc3c3fc2-1300-4024-b5c9-7b5f0902a62a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:09.933904 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-1136ec14-d54a-4850-a5d8-0aecfa5006dc req-9068543e-5ac8-4964-bd6c-c850265bd9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916159e1-4580-4bb4-a78f-857e9e15c61b", "name": "network-vif-deleted", "tag": "4003555e-bf92-479e-b2dd-be6fe4500b56"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:09.941453 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-dc3c3fc2-1300-4024-b5c9-7b5f0902a62a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1211 microversion: 2.1 time: 0.112288 Jun 20 14:57:09.942499 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 295/606] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:09 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1211 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:57:09.946424 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-1136ec14-d54a-4850-a5d8-0aecfa5006dc req-9068543e-5ac8-4964-bd6c-c850265bd9ac service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:09.947026 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-1136ec14-d54a-4850-a5d8-0aecfa5006dc req-9068543e-5ac8-4964-bd6c-c850265bd9ac service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:09.961489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-1136ec14-d54a-4850-a5d8-0aecfa5006dc req-9068543e-5ac8-4964-bd6c-c850265bd9ac service nova] Creating event network-vif-deleted:4003555e-bf92-479e-b2dd-be6fe4500b56 for instance 916159e1-4580-4bb4-a78f-857e9e15c61b on hv-cinder-83697 Jun 20 14:57:09.966977 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-1136ec14-d54a-4850-a5d8-0aecfa5006dc req-9068543e-5ac8-4964-bd6c-c850265bd9ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038296 Jun 20 14:57:09.968008 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 312/607] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:10.409596 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0b645de5-401f-40ab-abbc-3690c5f9d5d9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:10.410225 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-0b645de5-401f-40ab-abbc-3690c5f9d5d9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:10.417473 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0b645de5-401f-40ab-abbc-3690c5f9d5d9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:10.417912 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0b645de5-401f-40ab-abbc-3690c5f9d5d9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:10.418673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0b645de5-401f-40ab-abbc-3690c5f9d5d9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:10.419097 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0b645de5-401f-40ab-abbc-3690c5f9d5d9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:10.452345 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0b645de5-401f-40ab-abbc-3690c5f9d5d9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:10.452785 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0b645de5-401f-40ab-abbc-3690c5f9d5d9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:10.453445 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-0b645de5-401f-40ab-abbc-3690c5f9d5d9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lazy-loading 'fault' on Instance uuid 80267d79-170a-4c4e-b7fe-dfff49c7f195 {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:57:10.456407 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:10.497148 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0b645de5-401f-40ab-abbc-3690c5f9d5d9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afc8379be09748a68ade6af9b99cdfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1333ac4890624e11941a2681b51b07ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:10.505756 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0b645de5-401f-40ab-abbc-3690c5f9d5d9 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 200 len: 1312 microversion: 2.1 time: 0.100352 Jun 20 14:57:10.506358 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 296/608] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:10 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:10.547702 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0ce19c1a-af8c-42fb-8e48-3f67335461e4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:10.548388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-0ce19c1a-af8c-42fb-8e48-3f67335461e4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:10.554860 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0ce19c1a-af8c-42fb-8e48-3f67335461e4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:10.555376 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0ce19c1a-af8c-42fb-8e48-3f67335461e4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:10.556205 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0ce19c1a-af8c-42fb-8e48-3f67335461e4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:10.556702 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0ce19c1a-af8c-42fb-8e48-3f67335461e4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:10.620278 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0ce19c1a-af8c-42fb-8e48-3f67335461e4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:10.629294 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0ce19c1a-af8c-42fb-8e48-3f67335461e4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:10.630819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0ce19c1a-af8c-42fb-8e48-3f67335461e4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:10.632007 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0ce19c1a-af8c-42fb-8e48-3f67335461e4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1657 microversion: 2.20 time: 0.089259 Jun 20 14:57:10.632572 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 313/609] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:10 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1657 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:57:10.834862 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-bcddfef3-b194-4bc6-8d48-e36edbd508bd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:10.835592 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-bcddfef3-b194-4bc6-8d48-e36edbd508bd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:10.838454 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:10.842806 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bcddfef3-b194-4bc6-8d48-e36edbd508bd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:10.843251 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bcddfef3-b194-4bc6-8d48-e36edbd508bd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:10.844006 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bcddfef3-b194-4bc6-8d48-e36edbd508bd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:10.844447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bcddfef3-b194-4bc6-8d48-e36edbd508bd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:10.959071 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1a8b330b-5cea-476a-9674-fcd3534f9781 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:10.960138 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-1a8b330b-5cea-476a-9674-fcd3534f9781 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:10.965920 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:10.967768 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1a8b330b-5cea-476a-9674-fcd3534f9781 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:10.968967 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1a8b330b-5cea-476a-9674-fcd3534f9781 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:10.969932 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1a8b330b-5cea-476a-9674-fcd3534f9781 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:10.970561 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1a8b330b-5cea-476a-9674-fcd3534f9781 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:10.993045 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-bcddfef3-b194-4bc6-8d48-e36edbd508bd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:11.010224 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-bcddfef3-b194-4bc6-8d48-e36edbd508bd tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1679 microversion: 2.1 time: 0.178984 Jun 20 14:57:11.010842 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 297/610] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:10 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:11.069339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-1a8b330b-5cea-476a-9674-fcd3534f9781 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:11.076891 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1a8b330b-5cea-476a-9674-fcd3534f9781 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1211 microversion: 2.1 time: 0.121708 Jun 20 14:57:11.077467 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 314/611] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:10 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1211 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:11.523317 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c05d61bc-9e1e-4f05-a714-d142f1ba6251 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:11.524214 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-c05d61bc-9e1e-4f05-a714-d142f1ba6251 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] [instance: 80267d79-170a-4c4e-b7fe-dfff49c7f195] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:11.532192 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c05d61bc-9e1e-4f05-a714-d142f1ba6251 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:11.533006 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c05d61bc-9e1e-4f05-a714-d142f1ba6251 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:11.534031 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c05d61bc-9e1e-4f05-a714-d142f1ba6251 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:11.534690 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c05d61bc-9e1e-4f05-a714-d142f1ba6251 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:11.549405 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-c05d61bc-9e1e-4f05-a714-d142f1ba6251 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] HTTP exception thrown: Instance 80267d79-170a-4c4e-b7fe-dfff49c7f195 could not be found. Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c05d61bc-9e1e-4f05-a714-d142f1ba6251 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Request method failure captured: Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 HTTP/1.1 Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImcHJuSa1U2mDQw9Je2xMgVwCoBOENl4iMW3vovpnSsB3iLV2Wky6amoiYaxxO44qc2Z72Jit4az7ijT7wcCAZNHNcWZrT6z4FDrbh0ShQZbRnswOu_dl12QuYvC9Bxopa25pVc9jmSmMGQBHZ-89TuG0RSht7skWN3u3AnyB050GU Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: 1333ac4890624e11941a2681b51b07ab Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1970379770 Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:57:11.551351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:57:11.552950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1333ac4890624e11941a2681b51b07ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1333ac4890624e11941a2681b51b07ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1333ac4890624e11941a2681b51b07ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1333ac4890624e11941a2681b51b07ab"}]}] Jun 20 14:57:11.552950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1970379770 Jun 20 14:57:11.552950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: 1333ac4890624e11941a2681b51b07ab Jun 20 14:57:11.552950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1970379770 Jun 20 14:57:11.552950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-ServerRescueNegativeTestJSON-1970379770-project Jun 20 14:57:11.552950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:57:11.552950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:57:11.552950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: afc8379be09748a68ade6af9b99cdfa2 Jun 20 14:57:11.552950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1970379770-project Jun 20 14:57:11.552950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:57:11.552950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance 80267d79-170a-4c4e-b7fe-dfff49c7f195 could not be found. Jun 20 14:57:11.552950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': '80267d79-170a-4c4e-b7fe-dfff49c7f195'} Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80267d79-170a-4c4e-b7fe-dfff49c7f195 could not be found. Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:57:11.553921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80267d79-170a-4c4e-b7fe-dfff49c7f195 could not be found. Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80267d79-170a-4c4e-b7fe-dfff49c7f195 could not be found. Jun 20 14:57:11.555326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:57:11.557455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c05d61bc-9e1e-4f05-a714-d142f1ba6251 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] Returning 404 to user: Instance 80267d79-170a-4c4e-b7fe-dfff49c7f195 could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:57:11.558588 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-c05d61bc-9e1e-4f05-a714-d142f1ba6251 tempest-ServerRescueNegativeTestJSON-1970379770 tempest-ServerRescueNegativeTestJSON-1970379770-project] 10.222.0.23 "GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195" status: 404 len: 111 microversion: 2.1 time: 0.039517 Jun 20 14:57:11.565345 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 298/612] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:11 2022] GET /compute/v2.1/servers/80267d79-170a-4c4e-b7fe-dfff49c7f195 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:57:11.650340 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ba97b222-879b-4cbf-a706-11f3a98d452b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:11.650945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ba97b222-879b-4cbf-a706-11f3a98d452b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:11.658866 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba97b222-879b-4cbf-a706-11f3a98d452b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:11.659674 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba97b222-879b-4cbf-a706-11f3a98d452b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:11.660708 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba97b222-879b-4cbf-a706-11f3a98d452b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:11.661378 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba97b222-879b-4cbf-a706-11f3a98d452b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:11.711589 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba97b222-879b-4cbf-a706-11f3a98d452b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:11.712203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba97b222-879b-4cbf-a706-11f3a98d452b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:11.712890 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.objects.instance [None req-ba97b222-879b-4cbf-a706-11f3a98d452b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lazy-loading 'fault' on Instance uuid 916159e1-4580-4bb4-a78f-857e9e15c61b {{(pid=123979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:57:11.770101 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ba97b222-879b-4cbf-a706-11f3a98d452b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:11.780352 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ba97b222-879b-4cbf-a706-11f3a98d452b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:11.782826 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ba97b222-879b-4cbf-a706-11f3a98d452b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:11.784329 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ba97b222-879b-4cbf-a706-11f3a98d452b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 200 len: 1372 microversion: 2.20 time: 0.137956 Jun 20 14:57:11.785553 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 315/613] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:11 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 1372 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:57:12.096742 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-da7d0316-9764-475e-a267-0e2c3aa00850 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:12.097419 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-da7d0316-9764-475e-a267-0e2c3aa00850 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:12.115000 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-da7d0316-9764-475e-a267-0e2c3aa00850 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:12.118654 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-da7d0316-9764-475e-a267-0e2c3aa00850 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:12.119801 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-da7d0316-9764-475e-a267-0e2c3aa00850 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:12.121346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-da7d0316-9764-475e-a267-0e2c3aa00850 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:12.186684 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-78638806-b797-48f1-927b-e4b13e1c41d7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:12.187397 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-78638806-b797-48f1-927b-e4b13e1c41d7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:12.195102 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-78638806-b797-48f1-927b-e4b13e1c41d7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:12.195794 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-78638806-b797-48f1-927b-e4b13e1c41d7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:12.196921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-78638806-b797-48f1-927b-e4b13e1c41d7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:12.197589 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-78638806-b797-48f1-927b-e4b13e1c41d7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:12.379659 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-da7d0316-9764-475e-a267-0e2c3aa00850 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:12.387498 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-da7d0316-9764-475e-a267-0e2c3aa00850 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1267 microversion: 2.1 time: 0.297315 Jun 20 14:57:12.388089 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 316/614] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:12 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1267 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:57:12.545067 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-78638806-b797-48f1-927b-e4b13e1c41d7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:12.559805 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-78638806-b797-48f1-927b-e4b13e1c41d7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1679 microversion: 2.1 time: 0.535015 Jun 20 14:57:12.561609 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 299/615] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:12 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1679 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:12.570076 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-6bb1ac45-9e41-4a6f-8610-a32627422371 req-60bc7d3c-6538-40ee-b90a-3c86bdfebd3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3dceca0-38a5-404e-bc35-fd76511a1be5", "tag": "84467f18-b602-44a1-99d2-d1244386374a"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:12.584221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-6bb1ac45-9e41-4a6f-8610-a32627422371 req-60bc7d3c-6538-40ee-b90a-3c86bdfebd3b service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:12.584661 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-6bb1ac45-9e41-4a6f-8610-a32627422371 req-60bc7d3c-6538-40ee-b90a-3c86bdfebd3b service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:12.606180 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-6bb1ac45-9e41-4a6f-8610-a32627422371 req-60bc7d3c-6538-40ee-b90a-3c86bdfebd3b service nova] Creating event network-changed:84467f18-b602-44a1-99d2-d1244386374a for instance b3dceca0-38a5-404e-bc35-fd76511a1be5 on hv-cinder-83697 Jun 20 14:57:12.612521 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-6bb1ac45-9e41-4a6f-8610-a32627422371 req-60bc7d3c-6538-40ee-b90a-3c86bdfebd3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045885 Jun 20 14:57:12.613767 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 317/616] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:12.803250 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2447e159-a012-4401-b9f0-7bf4278b7a76 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:12.803867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2447e159-a012-4401-b9f0-7bf4278b7a76 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:12.810030 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2447e159-a012-4401-b9f0-7bf4278b7a76 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:12.810478 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2447e159-a012-4401-b9f0-7bf4278b7a76 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:12.811575 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2447e159-a012-4401-b9f0-7bf4278b7a76 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:12.813582 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2447e159-a012-4401-b9f0-7bf4278b7a76 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:12.830505 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-2447e159-a012-4401-b9f0-7bf4278b7a76 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] HTTP exception thrown: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2447e159-a012-4401-b9f0-7bf4278b7a76 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Request method failure captured: Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b HTTP/1.1 Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisIn1omX1LdPmoP7_iLX9vyogN9njqksXXS4meXl1V0zIzeu1OtU2r7vRNyp89nH7TTTJOuB10m14UZQw4a17YxwE2ATTaGDqOemFVz54o5yguZzhysIuoRL9T8bm4oSqwCCrkMq5_cPvPVWdqIjrDUaHPRD8z803038RSDklaAO17Rw Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: a98f7478c9384ee298321a1506aa0bde Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:57:12.832790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:57:12.834673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a98f7478c9384ee298321a1506aa0bde"}]}] Jun 20 14:57:12.834673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:57:12.834673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: a98f7478c9384ee298321a1506aa0bde Jun 20 14:57:12.834673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:57:12.834673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-AttachVolumeShelveTestJSON-2055176739-project Jun 20 14:57:12.834673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:57:12.834673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:57:12.834673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 69c4f81285904da78e96a4a515ec2cb2 Jun 20 14:57:12.834673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2055176739-project Jun 20 14:57:12.834673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:57:12.834673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. Jun 20 14:57:12.834673 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': '916159e1-4580-4bb4-a78f-857e9e15c61b'} Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:57:12.835406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. Jun 20 14:57:12.836954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:57:12.839791 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2447e159-a012-4401-b9f0-7bf4278b7a76 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Returning 404 to user: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:57:12.842243 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2447e159-a012-4401-b9f0-7bf4278b7a76 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 404 len: 111 microversion: 2.20 time: 0.042546 Jun 20 14:57:12.847191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 300/617] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:12 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 14:57:12.855452 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8a60e998-f508-442c-9fa1-c70a10056cec tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '.version_select at 0x7fce509e2940>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:12.883776 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-8a60e998-f508-442c-9fa1-c70a10056cec tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926544898" status: 204 len: 0 microversion: 2.20 time: 0.034438 Jun 20 14:57:12.884399 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 318/618] 10.222.0.23 () {60 vars in 1261 bytes} [Mon Jun 20 14:57:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926544898 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 20 14:57:13.332109 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-7c2461ad-eff5-474c-abd7-9eccd0032858 req-1c96d4fa-19f5-4b49-a5a2-1a622c418b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc2b001-2afc-4387-bc75-f9a40d79d9ac", "name": "network-vif-deleted", "tag": "6618345b-185a-4b31-8a55-c40aa36c68e5"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:13.350671 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-7c2461ad-eff5-474c-abd7-9eccd0032858 req-1c96d4fa-19f5-4b49-a5a2-1a622c418b8b service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:13.351406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-7c2461ad-eff5-474c-abd7-9eccd0032858 req-1c96d4fa-19f5-4b49-a5a2-1a622c418b8b service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:13.380452 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-7c2461ad-eff5-474c-abd7-9eccd0032858 req-1c96d4fa-19f5-4b49-a5a2-1a622c418b8b service nova] Creating event network-vif-deleted:6618345b-185a-4b31-8a55-c40aa36c68e5 for instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac on hv-cinder-83697 Jun 20 14:57:13.395146 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-7c2461ad-eff5-474c-abd7-9eccd0032858 req-1c96d4fa-19f5-4b49-a5a2-1a622c418b8b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068770 Jun 20 14:57:13.397040 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 301/619] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:13.410584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-a09e81cc-02a3-4731-a50d-81018a772034 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:13.415661 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-a09e81cc-02a3-4731-a50d-81018a772034 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:13.449469 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a09e81cc-02a3-4731-a50d-81018a772034 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:13.450183 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a09e81cc-02a3-4731-a50d-81018a772034 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:13.451601 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a09e81cc-02a3-4731-a50d-81018a772034 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:13.452115 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a09e81cc-02a3-4731-a50d-81018a772034 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:13.578934 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2cc98779-c26e-4908-a05d-5cb3bf6c264a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:13.579994 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2cc98779-c26e-4908-a05d-5cb3bf6c264a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:13.589008 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2cc98779-c26e-4908-a05d-5cb3bf6c264a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:13.589725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2cc98779-c26e-4908-a05d-5cb3bf6c264a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:13.590694 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2cc98779-c26e-4908-a05d-5cb3bf6c264a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:13.591450 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2cc98779-c26e-4908-a05d-5cb3bf6c264a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:13.638657 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2cc98779-c26e-4908-a05d-5cb3bf6c264a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:13.639521 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2cc98779-c26e-4908-a05d-5cb3bf6c264a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:13.640126 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-2cc98779-c26e-4908-a05d-5cb3bf6c264a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lazy-loading 'fault' on Instance uuid 4dc2b001-2afc-4387-bc75-f9a40d79d9ac {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:57:13.660823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a09e81cc-02a3-4731-a50d-81018a772034 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:13.668665 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-a09e81cc-02a3-4731-a50d-81018a772034 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1267 microversion: 2.1 time: 0.267362 Jun 20 14:57:13.669650 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 319/620] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:13 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1267 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:13.747212 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2cc98779-c26e-4908-a05d-5cb3bf6c264a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:13.755710 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2cc98779-c26e-4908-a05d-5cb3bf6c264a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 200 len: 1331 microversion: 2.1 time: 0.182165 Jun 20 14:57:13.756677 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 302/621] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:13 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 1331 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:57:14.543954 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1f393cf2-153d-4baa-b870-a6fe6dad5be5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Action: 'create', calling method: .version_select at 0x7fce50a9ab80>, body: {"keypair": {"name": "tempest-keypair-1429421949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKbAHdgwrJYOrYaWiiwwHD6FL3reL+MNX1rHYCTFOs8P3K1Eu3qgTfr8kp8oQUQv0xVP7Gtw3w+vLPWgjb77dnUmhH3LgJVYtsu0Xs4fj1HrBFFkKHEAMjRhM7e965j7A=="}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:14.560441 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-1f393cf2-153d-4baa-b870-a6fe6dad5be5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Getting quotas for project a98f7478c9384ee298321a1506aa0bde. Resources: {'key_pairs'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:57:14.566340 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-1f393cf2-153d-4baa-b870-a6fe6dad5be5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Getting quotas for user 69c4f81285904da78e96a4a515ec2cb2 and project a98f7478c9384ee298321a1506aa0bde. Resources: {'key_pairs'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:57:14.592592 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1f393cf2-153d-4baa-b870-a6fe6dad5be5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053201 Jun 20 14:57:14.593805 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 320/622] 10.222.0.23 () {62 vars in 1199 bytes} [Mon Jun 20 14:57:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 20 14:57:14.686783 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7b8efc2a-d953-4d8f-9967-aa60bbc01858 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:14.688806 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7b8efc2a-d953-4d8f-9967-aa60bbc01858 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:14.694541 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:14.695610 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=6 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:14.698192 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7b8efc2a-d953-4d8f-9967-aa60bbc01858 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:14.698912 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7b8efc2a-d953-4d8f-9967-aa60bbc01858 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:14.699770 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7b8efc2a-d953-4d8f-9967-aa60bbc01858 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:14.700413 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7b8efc2a-d953-4d8f-9967-aa60bbc01858 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:14.773561 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-63098cf9-3f56-49a2-a71b-9d824a9fbc97 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:14.774550 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-63098cf9-3f56-49a2-a71b-9d824a9fbc97 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:14.783048 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-63098cf9-3f56-49a2-a71b-9d824a9fbc97 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:14.784124 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-63098cf9-3f56-49a2-a71b-9d824a9fbc97 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:14.785210 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-63098cf9-3f56-49a2-a71b-9d824a9fbc97 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:14.785731 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-63098cf9-3f56-49a2-a71b-9d824a9fbc97 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:14.803741 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-63098cf9-3f56-49a2-a71b-9d824a9fbc97 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] HTTP exception thrown: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-63098cf9-3f56-49a2-a71b-9d824a9fbc97 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Request method failure captured: Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac HTTP/1.1 Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImbz0WxD1k9ycjcFtONQioapmstd9ALeY-XOY9KWzwZRC4BzRHKOJNKseVz_SOU8X1kqkeZceHCAJurCXmzp5osSOaO2_Ehpi_atwxfvtaZZDfF13_WZ-v9TPM1dlOrXp8wu-OjE4ErE1kdNfUTWsTDESJSRneLOLv_h39cbJpuqhQ Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:57:14.805449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:57:14.806773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}] Jun 20 14:57:14.806773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:57:14.806773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:57:14.806773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:57:14.806773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:57:14.806773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:57:14.806773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:57:14.806773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 87c3f39c0bed4fadbc8a556c857baf4a Jun 20 14:57:14.806773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:57:14.806773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:57:14.806773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. Jun 20 14:57:14.806773 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '4dc2b001-2afc-4387-bc75-f9a40d79d9ac'} Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:57:14.807478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. Jun 20 14:57:14.808616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:57:14.810917 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-63098cf9-3f56-49a2-a71b-9d824a9fbc97 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Returning 404 to user: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:57:14.810917 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-63098cf9-3f56-49a2-a71b-9d824a9fbc97 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 404 len: 111 microversion: 2.1 time: 0.039823 Jun 20 14:57:14.810917 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 321/623] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:14 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:57:14.818563 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-eabb648f-856d-4f0b-8d0c-a63a6dfafde1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '.version_select at 0x7fce509a4b80>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:14.847555 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-eabb648f-856d-4f0b-8d0c-a63a6dfafde1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-922701947" status: 202 len: 0 microversion: 2.1 time: 0.033559 Jun 20 14:57:14.848746 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 322/624] 10.222.0.23 () {58 vars in 1217 bytes} [Mon Jun 20 14:57:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-922701947 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 14:57:14.906701 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-7b8efc2a-d953-4d8f-9967-aa60bbc01858 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:14.918394 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7b8efc2a-d953-4d8f-9967-aa60bbc01858 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1267 microversion: 2.1 time: 0.236077 Jun 20 14:57:14.919109 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 303/625] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:14 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:15.768419 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-93690d16-ee74-42d4-9bce-8a0694a8e442 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Action: 'create', calling method: .version_select at 0x7fce509923a0>, body: {"keypair": {"name": "tempest-keypair-13715157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZkpkZWPrfpLKSFBdlwwSaDtIKWqHsIja7pFrV6kTN6cX/kNsZAatPwJWOW1qaM3nwXutYpxGAM5+YOXK48mj2cz6Qca4Rcjfz8ghX9sTBYPpcr9RDM9NITuvN2EVpWYg=="}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:15.783422 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-93690d16-ee74-42d4-9bce-8a0694a8e442 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'key_pairs'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:57:15.787241 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-93690d16-ee74-42d4-9bce-8a0694a8e442 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for user 87c3f39c0bed4fadbc8a556c857baf4a and project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'key_pairs'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:57:15.812106 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-93690d16-ee74-42d4-9bce-8a0694a8e442 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.048584 Jun 20 14:57:15.816882 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 323/626] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 14:57:15 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:15.937033 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7576c25e-f796-40dc-995d-5c5735f72770 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:15.938243 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7576c25e-f796-40dc-995d-5c5735f72770 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:15.947676 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7576c25e-f796-40dc-995d-5c5735f72770 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:15.948219 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7576c25e-f796-40dc-995d-5c5735f72770 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:15.949136 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7576c25e-f796-40dc-995d-5c5735f72770 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:15.949774 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7576c25e-f796-40dc-995d-5c5735f72770 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:16.257451 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-7576c25e-f796-40dc-995d-5c5735f72770 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:16.279269 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7576c25e-f796-40dc-995d-5c5735f72770 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1267 microversion: 2.1 time: 0.347162 Jun 20 14:57:16.279884 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 304/627] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:15 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1267 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:16.595547 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-74137900", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65993a3b-f9af-4743-b7d5-a4affcfed083"}], "security_groups": [{"name": "tempest-securitygroup--468638180"}], "key_name": "tempest-keypair-1429421949", "user_data": "}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:16.839430 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.network.neutron [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] validate_networks() for [('65993a3b-f9af-4743-b7d5-a4affcfed083', None, None, None, None, None)] {{(pid=123979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:57:17.297999 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0e760690-23e5-49d3-8c69-85b17d98e9bc tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:17.298844 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-0e760690-23e5-49d3-8c69-85b17d98e9bc tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:17.307206 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0e760690-23e5-49d3-8c69-85b17d98e9bc tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:17.307799 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0e760690-23e5-49d3-8c69-85b17d98e9bc tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:17.308611 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0e760690-23e5-49d3-8c69-85b17d98e9bc tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:17.309067 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0e760690-23e5-49d3-8c69-85b17d98e9bc tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:17.508485 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0e760690-23e5-49d3-8c69-85b17d98e9bc tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:17.517297 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0e760690-23e5-49d3-8c69-85b17d98e9bc tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1267 microversion: 2.1 time: 0.225266 Jun 20 14:57:17.517986 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 305/628] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:17 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:17.829054 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Flavor limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:57:17.829502 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Image limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:57:17.831324 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Flavor pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:57:17.832644 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Image pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:57:17.834197 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:57:17.852685 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:17.853393 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:17.854097 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:17.854824 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:17.875491 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Getting quotas for project a98f7478c9384ee298321a1506aa0bde. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:57:17.880838 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Getting quotas for user 69c4f81285904da78e96a4a515ec2cb2 and project a98f7478c9384ee298321a1506aa0bde. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:57:17.896470 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Going to run 1 instances... {{(pid=123979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:57:17.898927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:57:17.954326 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3149bec2-cb2c-42bc-8278-56c9310dc26f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.364446 Jun 20 14:57:17.954999 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 324/629] 10.222.0.23 () {62 vars in 1187 bytes} [Mon Jun 20 14:57:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 14:57:17.965504 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c210a23e-85a0-45d5-b0e3-3d718f8d14a5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:17.966441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-c210a23e-85a0-45d5-b0e3-3d718f8d14a5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:18.039381 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-c210a23e-85a0-45d5-b0e3-3d718f8d14a5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:18.047323 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-c210a23e-85a0-45d5-b0e3-3d718f8d14a5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:18.048856 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-c210a23e-85a0-45d5-b0e3-3d718f8d14a5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:18.049974 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-c210a23e-85a0-45d5-b0e3-3d718f8d14a5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1280 microversion: 2.20 time: 0.088519 Jun 20 14:57:18.050531 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 306/630] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:17 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:57:18.086672 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-303899734", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2b22871-0b88-408a-81b6-567b6c78e97d"}], "security_groups": [{"name": "tempest-securitygroup--2110419279"}], "key_name": "tempest-keypair-13715157", "user_data": "}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:18.217709 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.network.neutron [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] validate_networks() for [('b2b22871-0b88-408a-81b6-567b6c78e97d', None, None, None, None, None)] {{(pid=123979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:57:18.535558 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d8214190-b2b6-4d0d-b170-db721c6af096 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:18.539608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-d8214190-b2b6-4d0d-b170-db721c6af096 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:18.546784 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d8214190-b2b6-4d0d-b170-db721c6af096 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:18.547311 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d8214190-b2b6-4d0d-b170-db721c6af096 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:18.548070 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d8214190-b2b6-4d0d-b170-db721c6af096 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:18.548686 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d8214190-b2b6-4d0d-b170-db721c6af096 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:18.617658 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Flavor limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:57:18.618103 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Image limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:57:18.618573 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Flavor pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:57:18.619262 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Image pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:57:18.619673 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:57:18.632457 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:18.633368 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:18.634163 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:18.634595 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:18.656507 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:57:18.661451 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Getting quotas for user 87c3f39c0bed4fadbc8a556c857baf4a and project 532cbc0c846c4a528fccd85b0b8ab4d8. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:57:18.676678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Going to run 1 instances... {{(pid=123979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:57:18.679075 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:57:18.692001 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d8214190-b2b6-4d0d-b170-db721c6af096 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:18.700774 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d8214190-b2b6-4d0d-b170-db721c6af096 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1267 microversion: 2.1 time: 0.170611 Jun 20 14:57:18.705327 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 307/631] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:18 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:57:18.733339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ccc49771-c8df-4568-85d2-64d34b6c231e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.650671 Jun 20 14:57:18.734973 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 325/632] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 14:57:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 14:57:18.744947 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-26b0dfdf-32de-4a17-b521-9285c14e959c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:18.745781 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-26b0dfdf-32de-4a17-b521-9285c14e959c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:18.819199 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-26b0dfdf-32de-4a17-b521-9285c14e959c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:18.826527 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-26b0dfdf-32de-4a17-b521-9285c14e959c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 200 len: 1239 microversion: 2.1 time: 0.085576 Jun 20 14:57:18.833532 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 308/633] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:18 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 1239 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:19.068057 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3a26fb12-97db-4876-9147-2e8af2ed382c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:19.068664 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3a26fb12-97db-4876-9147-2e8af2ed382c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:19.075628 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3a26fb12-97db-4876-9147-2e8af2ed382c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:19.076111 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3a26fb12-97db-4876-9147-2e8af2ed382c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:19.077073 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3a26fb12-97db-4876-9147-2e8af2ed382c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:19.077506 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3a26fb12-97db-4876-9147-2e8af2ed382c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:19.149014 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3a26fb12-97db-4876-9147-2e8af2ed382c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:19.157535 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3a26fb12-97db-4876-9147-2e8af2ed382c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:19.159025 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3a26fb12-97db-4876-9147-2e8af2ed382c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:19.160123 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3a26fb12-97db-4876-9147-2e8af2ed382c tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1332 microversion: 2.20 time: 0.096302 Jun 20 14:57:19.160672 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 326/634] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:19 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:57:19.719360 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-01a3f133-493e-4184-9b83-fe20ed02eebd tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:19.720662 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-01a3f133-493e-4184-9b83-fe20ed02eebd tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:19.729762 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-01a3f133-493e-4184-9b83-fe20ed02eebd tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:19.730602 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-01a3f133-493e-4184-9b83-fe20ed02eebd tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:19.731520 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-01a3f133-493e-4184-9b83-fe20ed02eebd tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:19.731974 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-01a3f133-493e-4184-9b83-fe20ed02eebd tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:19.844770 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0111421c-2664-46b6-9caf-24106745a759 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:19.845897 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-0111421c-2664-46b6-9caf-24106745a759 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:19.854008 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0111421c-2664-46b6-9caf-24106745a759 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:19.854834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0111421c-2664-46b6-9caf-24106745a759 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:19.855896 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0111421c-2664-46b6-9caf-24106745a759 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:19.856542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0111421c-2664-46b6-9caf-24106745a759 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:19.903820 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-01a3f133-493e-4184-9b83-fe20ed02eebd tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:19.916098 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-01a3f133-493e-4184-9b83-fe20ed02eebd tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1267 microversion: 2.1 time: 0.200323 Jun 20 14:57:19.940924 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 309/635] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:19 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:19.954410 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0111421c-2664-46b6-9caf-24106745a759 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:19.966202 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0111421c-2664-46b6-9caf-24106745a759 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 200 len: 1291 microversion: 2.1 time: 0.126143 Jun 20 14:57:19.968440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 327/636] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:19 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 1291 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:57:20.181862 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-134cb65b-de28-4bfe-9365-1938acbed4b1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:20.183025 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-134cb65b-de28-4bfe-9365-1938acbed4b1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:20.192415 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-134cb65b-de28-4bfe-9365-1938acbed4b1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:20.193151 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-134cb65b-de28-4bfe-9365-1938acbed4b1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:20.194102 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-134cb65b-de28-4bfe-9365-1938acbed4b1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:20.194684 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-134cb65b-de28-4bfe-9365-1938acbed4b1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:20.458492 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-134cb65b-de28-4bfe-9365-1938acbed4b1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:20.472321 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-134cb65b-de28-4bfe-9365-1938acbed4b1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:20.473915 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-134cb65b-de28-4bfe-9365-1938acbed4b1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:20.477534 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-134cb65b-de28-4bfe-9365-1938acbed4b1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1405 microversion: 2.20 time: 0.299305 Jun 20 14:57:20.480925 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 310/637] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:20 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1405 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:57:20.934688 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3c466119-a9f1-4029-a9f3-ca456477f289 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:20.935299 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3c466119-a9f1-4029-a9f3-ca456477f289 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:20.943618 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3c466119-a9f1-4029-a9f3-ca456477f289 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:20.944146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3c466119-a9f1-4029-a9f3-ca456477f289 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:20.944997 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3c466119-a9f1-4029-a9f3-ca456477f289 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:20.945637 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3c466119-a9f1-4029-a9f3-ca456477f289 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:20.983785 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-09f8af76-8a44-4a1e-81b5-8a95de2b2710 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:20.984416 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-09f8af76-8a44-4a1e-81b5-8a95de2b2710 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:20.992220 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-09f8af76-8a44-4a1e-81b5-8a95de2b2710 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:20.993107 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-09f8af76-8a44-4a1e-81b5-8a95de2b2710 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:20.993923 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-09f8af76-8a44-4a1e-81b5-8a95de2b2710 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:20.994483 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-09f8af76-8a44-4a1e-81b5-8a95de2b2710 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:21.260341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-09f8af76-8a44-4a1e-81b5-8a95de2b2710 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:21.272848 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-09f8af76-8a44-4a1e-81b5-8a95de2b2710 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 200 len: 1365 microversion: 2.1 time: 0.291803 Jun 20 14:57:21.273734 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 311/638] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:20 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:57:21.305958 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3c466119-a9f1-4029-a9f3-ca456477f289 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:21.315927 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3c466119-a9f1-4029-a9f3-ca456477f289 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1267 microversion: 2.1 time: 0.385053 Jun 20 14:57:21.326453 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 328/639] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:20 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1267 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:21.516466 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-48714dcc-08b2-4e62-9dd4-bd25673ec845 req-6b792bf5-e74e-4fc4-93b5-549371356d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf05798-c6d2-444f-bed3-1a30d8a8a1bb", "tag": "6a7393ac-776d-4cd4-9e00-be227b057942"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:21.523033 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-72b19a67-b296-443a-927c-e6ef87dc8d83 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:21.526189 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-72b19a67-b296-443a-927c-e6ef87dc8d83 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:21.539827 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-48714dcc-08b2-4e62-9dd4-bd25673ec845 req-6b792bf5-e74e-4fc4-93b5-549371356d56 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:21.540298 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-48714dcc-08b2-4e62-9dd4-bd25673ec845 req-6b792bf5-e74e-4fc4-93b5-549371356d56 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:21.549066 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-72b19a67-b296-443a-927c-e6ef87dc8d83 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:21.550209 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-72b19a67-b296-443a-927c-e6ef87dc8d83 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:21.551307 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-72b19a67-b296-443a-927c-e6ef87dc8d83 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:21.552020 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-72b19a67-b296-443a-927c-e6ef87dc8d83 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:21.562981 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-48714dcc-08b2-4e62-9dd4-bd25673ec845 req-6b792bf5-e74e-4fc4-93b5-549371356d56 service nova] Creating event network-changed:6a7393ac-776d-4cd4-9e00-be227b057942 for instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb on hv-cinder-83697 Jun 20 14:57:21.568952 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-48714dcc-08b2-4e62-9dd4-bd25673ec845 req-6b792bf5-e74e-4fc4-93b5-549371356d56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056606 Jun 20 14:57:21.570335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 329/640] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:21.837046 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-72b19a67-b296-443a-927c-e6ef87dc8d83 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:21.850156 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-72b19a67-b296-443a-927c-e6ef87dc8d83 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:21.853661 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-72b19a67-b296-443a-927c-e6ef87dc8d83 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:21.856012 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-72b19a67-b296-443a-927c-e6ef87dc8d83 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1405 microversion: 2.20 time: 0.359918 Jun 20 14:57:21.868428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 312/641] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:21 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1405 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:57:22.177607 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-567b74e5-2692-4faa-a7e4-3a6dd6cd3cd2 req-ac67e957-7b8f-412e-aa51-886682addca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a", "tag": "35e04bd3-d6a7-4435-9fb4-54ee749aff5b"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:22.200627 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-567b74e5-2692-4faa-a7e4-3a6dd6cd3cd2 req-ac67e957-7b8f-412e-aa51-886682addca8 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:22.201323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-567b74e5-2692-4faa-a7e4-3a6dd6cd3cd2 req-ac67e957-7b8f-412e-aa51-886682addca8 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:22.220265 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-567b74e5-2692-4faa-a7e4-3a6dd6cd3cd2 req-ac67e957-7b8f-412e-aa51-886682addca8 service nova] Creating event network-changed:35e04bd3-d6a7-4435-9fb4-54ee749aff5b for instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a on hv-cinder-83697 Jun 20 14:57:22.225457 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-567b74e5-2692-4faa-a7e4-3a6dd6cd3cd2 req-ac67e957-7b8f-412e-aa51-886682addca8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054217 Jun 20 14:57:22.226255 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 330/642] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:22.289703 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1efcdd0e-2069-4943-94ba-578db58f92fc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:22.290885 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1efcdd0e-2069-4943-94ba-578db58f92fc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:22.298585 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1efcdd0e-2069-4943-94ba-578db58f92fc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:22.299030 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1efcdd0e-2069-4943-94ba-578db58f92fc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:22.301613 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1efcdd0e-2069-4943-94ba-578db58f92fc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:22.302059 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1efcdd0e-2069-4943-94ba-578db58f92fc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:22.339674 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e2fe8013-89d0-4cdd-b60c-f45a76ebf45e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:22.340561 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e2fe8013-89d0-4cdd-b60c-f45a76ebf45e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:22.353071 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e2fe8013-89d0-4cdd-b60c-f45a76ebf45e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:22.353520 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e2fe8013-89d0-4cdd-b60c-f45a76ebf45e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:22.354290 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e2fe8013-89d0-4cdd-b60c-f45a76ebf45e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:22.354738 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e2fe8013-89d0-4cdd-b60c-f45a76ebf45e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:22.514619 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1efcdd0e-2069-4943-94ba-578db58f92fc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:22.522584 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1efcdd0e-2069-4943-94ba-578db58f92fc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 200 len: 1365 microversion: 2.1 time: 0.236731 Jun 20 14:57:22.524535 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 313/643] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:22 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:22.529860 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-f3fa4829-4249-4395-80a1-5c39569cc537 req-e93ec598-0586-4cb1-8c2d-e58bce5157a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3dceca0-38a5-404e-bc35-fd76511a1be5", "name": "network-vif-plugged", "status": "completed", "tag": "84467f18-b602-44a1-99d2-d1244386374a"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:22.538490 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-f3fa4829-4249-4395-80a1-5c39569cc537 req-e93ec598-0586-4cb1-8c2d-e58bce5157a9 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:22.539294 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-f3fa4829-4249-4395-80a1-5c39569cc537 req-e93ec598-0586-4cb1-8c2d-e58bce5157a9 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:22.553211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-f3fa4829-4249-4395-80a1-5c39569cc537 req-e93ec598-0586-4cb1-8c2d-e58bce5157a9 service nova] Creating event network-vif-plugged:84467f18-b602-44a1-99d2-d1244386374a for instance b3dceca0-38a5-404e-bc35-fd76511a1be5 on hv-cinder-83697 Jun 20 14:57:22.559790 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-f3fa4829-4249-4395-80a1-5c39569cc537 req-e93ec598-0586-4cb1-8c2d-e58bce5157a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033463 Jun 20 14:57:22.560836 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 314/644] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:22.575463 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e2fe8013-89d0-4cdd-b60c-f45a76ebf45e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:22.583482 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e2fe8013-89d0-4cdd-b60c-f45a76ebf45e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1267 microversion: 2.1 time: 0.253750 Jun 20 14:57:22.584052 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 331/645] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:22 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:57:22.876681 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d0036b81-56e5-4828-baf6-358690adf9dd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:22.877449 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-d0036b81-56e5-4828-baf6-358690adf9dd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:22.885129 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d0036b81-56e5-4828-baf6-358690adf9dd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:22.886004 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d0036b81-56e5-4828-baf6-358690adf9dd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:22.887034 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d0036b81-56e5-4828-baf6-358690adf9dd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:22.888011 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d0036b81-56e5-4828-baf6-358690adf9dd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:23.486881 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d0036b81-56e5-4828-baf6-358690adf9dd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:23.496215 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d0036b81-56e5-4828-baf6-358690adf9dd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:23.497744 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d0036b81-56e5-4828-baf6-358690adf9dd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:23.498876 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d0036b81-56e5-4828-baf6-358690adf9dd tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1405 microversion: 2.20 time: 0.627344 Jun 20 14:57:23.509486 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 315/646] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:22 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1405 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:57:23.543576 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-720e9431-afb0-4eb2-a885-1e3e91f8ee4d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:23.544783 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-720e9431-afb0-4eb2-a885-1e3e91f8ee4d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:23.553136 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-720e9431-afb0-4eb2-a885-1e3e91f8ee4d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:23.553592 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-720e9431-afb0-4eb2-a885-1e3e91f8ee4d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:23.554358 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-720e9431-afb0-4eb2-a885-1e3e91f8ee4d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:23.554789 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-720e9431-afb0-4eb2-a885-1e3e91f8ee4d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:23.599609 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-90a9dc73-5952-482e-a6ed-16693e4655a5 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:23.600216 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-90a9dc73-5952-482e-a6ed-16693e4655a5 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:23.606637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-90a9dc73-5952-482e-a6ed-16693e4655a5 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:23.607158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-90a9dc73-5952-482e-a6ed-16693e4655a5 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:23.608157 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-90a9dc73-5952-482e-a6ed-16693e4655a5 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:23.608883 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-90a9dc73-5952-482e-a6ed-16693e4655a5 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:23.845273 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-90a9dc73-5952-482e-a6ed-16693e4655a5 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:23.849333 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-720e9431-afb0-4eb2-a885-1e3e91f8ee4d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:23.854969 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-90a9dc73-5952-482e-a6ed-16693e4655a5 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1267 microversion: 2.1 time: 0.258774 Jun 20 14:57:23.855730 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 316/647] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:23 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:23.857466 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-720e9431-afb0-4eb2-a885-1e3e91f8ee4d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 200 len: 1365 microversion: 2.1 time: 0.320867 Jun 20 14:57:23.858020 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 332/648] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:23 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:24.519340 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-fafef428-1dc0-4b3c-85ee-73dc91eeaba7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:24.519875 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-fafef428-1dc0-4b3c-85ee-73dc91eeaba7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:24.526895 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fafef428-1dc0-4b3c-85ee-73dc91eeaba7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:24.527422 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fafef428-1dc0-4b3c-85ee-73dc91eeaba7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:24.528264 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fafef428-1dc0-4b3c-85ee-73dc91eeaba7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:24.528766 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fafef428-1dc0-4b3c-85ee-73dc91eeaba7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:24.548237 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=100 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:24.662893 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-fafef428-1dc0-4b3c-85ee-73dc91eeaba7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:24.675059 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-fafef428-1dc0-4b3c-85ee-73dc91eeaba7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:24.677372 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-fafef428-1dc0-4b3c-85ee-73dc91eeaba7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:24.679056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-fafef428-1dc0-4b3c-85ee-73dc91eeaba7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1405 microversion: 2.20 time: 0.165414 Jun 20 14:57:24.679857 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 317/649] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:24 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:57:24.871521 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-98bdd119-da57-4a93-acaa-152ec3a15053 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:24.872129 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-98bdd119-da57-4a93-acaa-152ec3a15053 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:24.873551 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-9b571d48-59c7-4859-9452-aab298d11fca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:24.874165 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-9b571d48-59c7-4859-9452-aab298d11fca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:24.879190 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-98bdd119-da57-4a93-acaa-152ec3a15053 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:24.879644 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-98bdd119-da57-4a93-acaa-152ec3a15053 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:24.880392 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-98bdd119-da57-4a93-acaa-152ec3a15053 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:24.880851 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-98bdd119-da57-4a93-acaa-152ec3a15053 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:24.881125 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9b571d48-59c7-4859-9452-aab298d11fca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:24.881572 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9b571d48-59c7-4859-9452-aab298d11fca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:24.882329 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9b571d48-59c7-4859-9452-aab298d11fca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:24.882764 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9b571d48-59c7-4859-9452-aab298d11fca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:25.014195 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-98bdd119-da57-4a93-acaa-152ec3a15053 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:25.015965 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-9b571d48-59c7-4859-9452-aab298d11fca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:25.022585 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-98bdd119-da57-4a93-acaa-152ec3a15053 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1455 microversion: 2.1 time: 0.154852 Jun 20 14:57:25.023137 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 333/650] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:24 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:25.023580 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-9b571d48-59c7-4859-9452-aab298d11fca tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 200 len: 1365 microversion: 2.1 time: 0.153820 Jun 20 14:57:25.024366 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 318/651] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:24 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:25.038403 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8171ebed-755d-4327-afe9-09df57aeed36 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:25.039033 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-8171ebed-755d-4327-afe9-09df57aeed36 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:25.045314 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8171ebed-755d-4327-afe9-09df57aeed36 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:25.045759 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8171ebed-755d-4327-afe9-09df57aeed36 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:25.046578 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8171ebed-755d-4327-afe9-09df57aeed36 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:25.047072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8171ebed-755d-4327-afe9-09df57aeed36 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:25.189506 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8171ebed-755d-4327-afe9-09df57aeed36 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:25.193096 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=100 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:25.198145 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-8171ebed-755d-4327-afe9-09df57aeed36 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1455 microversion: 2.1 time: 0.163398 Jun 20 14:57:25.198714 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 334/652] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:25 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:25.697353 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-cfb79340-5b36-46af-94d6-c0829520b193 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:25.697951 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-cfb79340-5b36-46af-94d6-c0829520b193 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:25.705271 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cfb79340-5b36-46af-94d6-c0829520b193 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:25.705766 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cfb79340-5b36-46af-94d6-c0829520b193 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:25.706551 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cfb79340-5b36-46af-94d6-c0829520b193 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:25.706969 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cfb79340-5b36-46af-94d6-c0829520b193 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:25.921166 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-cfb79340-5b36-46af-94d6-c0829520b193 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:25.930719 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-cfb79340-5b36-46af-94d6-c0829520b193 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:25.932261 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-cfb79340-5b36-46af-94d6-c0829520b193 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:25.933386 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-cfb79340-5b36-46af-94d6-c0829520b193 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1405 microversion: 2.20 time: 0.240145 Jun 20 14:57:25.933984 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 319/653] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:25 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:57:26.041845 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9831d42a-fd0d-4a95-85b7-911586f5ee08 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:26.043140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9831d42a-fd0d-4a95-85b7-911586f5ee08 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:26.046059 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=2,nova_api:INSERT=8 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:26.049738 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9831d42a-fd0d-4a95-85b7-911586f5ee08 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:26.050164 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9831d42a-fd0d-4a95-85b7-911586f5ee08 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:26.051135 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9831d42a-fd0d-4a95-85b7-911586f5ee08 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:26.051547 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9831d42a-fd0d-4a95-85b7-911586f5ee08 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:26.126405 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-7e1c80c2-488b-4db6-855d-9bea048b1fe8 req-07155263-32b2-4763-829e-b583093594d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf05798-c6d2-444f-bed3-1a30d8a8a1bb", "name": "network-vif-plugged", "status": "completed", "tag": "6a7393ac-776d-4cd4-9e00-be227b057942"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:26.135570 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-7e1c80c2-488b-4db6-855d-9bea048b1fe8 req-07155263-32b2-4763-829e-b583093594d8 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:26.136315 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-7e1c80c2-488b-4db6-855d-9bea048b1fe8 req-07155263-32b2-4763-829e-b583093594d8 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:26.152841 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-7e1c80c2-488b-4db6-855d-9bea048b1fe8 req-07155263-32b2-4763-829e-b583093594d8 service nova] Creating event network-vif-plugged:6a7393ac-776d-4cd4-9e00-be227b057942 for instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb on hv-cinder-83697 Jun 20 14:57:26.158231 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-7e1c80c2-488b-4db6-855d-9bea048b1fe8 req-07155263-32b2-4763-829e-b583093594d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036515 Jun 20 14:57:26.159480 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 320/654] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 14:57:26.205925 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9831d42a-fd0d-4a95-85b7-911586f5ee08 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:26.213656 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9831d42a-fd0d-4a95-85b7-911586f5ee08 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 200 len: 1365 microversion: 2.1 time: 0.177447 Jun 20 14:57:26.214722 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 335/655] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:26 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:26.953333 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6a6b3155-0efe-4bb9-9345-c0e0035ff747 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:26.953852 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6a6b3155-0efe-4bb9-9345-c0e0035ff747 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:26.964855 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6a6b3155-0efe-4bb9-9345-c0e0035ff747 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:26.965779 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6a6b3155-0efe-4bb9-9345-c0e0035ff747 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:26.967376 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6a6b3155-0efe-4bb9-9345-c0e0035ff747 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:26.968172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6a6b3155-0efe-4bb9-9345-c0e0035ff747 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:27.205832 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-6a6b3155-0efe-4bb9-9345-c0e0035ff747 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:27.214877 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-6a6b3155-0efe-4bb9-9345-c0e0035ff747 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:27.216768 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-6a6b3155-0efe-4bb9-9345-c0e0035ff747 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:27.218205 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6a6b3155-0efe-4bb9-9345-c0e0035ff747 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1405 microversion: 2.20 time: 0.270381 Jun 20 14:57:27.219054 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 321/656] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:26 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1405 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:57:27.231076 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9a712c9a-9f7a-4cc0-aeae-21219eeb8938 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:27.232001 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9a712c9a-9f7a-4cc0-aeae-21219eeb8938 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:27.238711 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9a712c9a-9f7a-4cc0-aeae-21219eeb8938 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:27.239155 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9a712c9a-9f7a-4cc0-aeae-21219eeb8938 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:27.239924 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9a712c9a-9f7a-4cc0-aeae-21219eeb8938 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:27.240348 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9a712c9a-9f7a-4cc0-aeae-21219eeb8938 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:27.253806 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-29f0cdc9-6603-4a5b-a6df-d0a1900e969c req-2475508c-3751-4855-b3fb-5cdbf43c958c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3dceca0-38a5-404e-bc35-fd76511a1be5", "tag": "84467f18-b602-44a1-99d2-d1244386374a"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:27.262584 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-29f0cdc9-6603-4a5b-a6df-d0a1900e969c req-2475508c-3751-4855-b3fb-5cdbf43c958c service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:27.263025 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-29f0cdc9-6603-4a5b-a6df-d0a1900e969c req-2475508c-3751-4855-b3fb-5cdbf43c958c service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:27.274293 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-29f0cdc9-6603-4a5b-a6df-d0a1900e969c req-2475508c-3751-4855-b3fb-5cdbf43c958c service nova] Creating event network-changed:84467f18-b602-44a1-99d2-d1244386374a for instance b3dceca0-38a5-404e-bc35-fd76511a1be5 on hv-cinder-83697 Jun 20 14:57:27.279990 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-29f0cdc9-6603-4a5b-a6df-d0a1900e969c req-2475508c-3751-4855-b3fb-5cdbf43c958c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029446 Jun 20 14:57:27.280753 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 322/657] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 14:57:27.398265 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9a712c9a-9f7a-4cc0-aeae-21219eeb8938 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:27.407463 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9a712c9a-9f7a-4cc0-aeae-21219eeb8938 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 200 len: 1365 microversion: 2.1 time: 0.180318 Jun 20 14:57:27.413214 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 336/658] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:27 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:28.241968 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-11ee49f9-4eff-4a2b-9257-d0df30c526f6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:28.243153 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-11ee49f9-4eff-4a2b-9257-d0df30c526f6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:28.256182 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-11ee49f9-4eff-4a2b-9257-d0df30c526f6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:28.256656 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-11ee49f9-4eff-4a2b-9257-d0df30c526f6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:28.257488 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-11ee49f9-4eff-4a2b-9257-d0df30c526f6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:28.257944 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-11ee49f9-4eff-4a2b-9257-d0df30c526f6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:28.424626 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-dbd464a5-b64a-4776-823e-3fc84213057a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:28.425868 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-dbd464a5-b64a-4776-823e-3fc84213057a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:28.435436 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dbd464a5-b64a-4776-823e-3fc84213057a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:28.436839 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dbd464a5-b64a-4776-823e-3fc84213057a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:28.438009 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dbd464a5-b64a-4776-823e-3fc84213057a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:28.449630 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dbd464a5-b64a-4776-823e-3fc84213057a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:28.470976 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-11ee49f9-4eff-4a2b-9257-d0df30c526f6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:28.479062 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-11ee49f9-4eff-4a2b-9257-d0df30c526f6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:28.480702 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-11ee49f9-4eff-4a2b-9257-d0df30c526f6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:28.481897 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-11ee49f9-4eff-4a2b-9257-d0df30c526f6 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1597 microversion: 2.20 time: 0.247936 Jun 20 14:57:28.482829 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 323/659] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:57:28 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1597 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:57:28.499106 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-767b99a1-1abf-4d43-9bef-74034663db7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:28.501059 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-767b99a1-1abf-4d43-9bef-74034663db7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:28.507746 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-767b99a1-1abf-4d43-9bef-74034663db7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:28.508601 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-767b99a1-1abf-4d43-9bef-74034663db7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:28.509153 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-767b99a1-1abf-4d43-9bef-74034663db7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:28.509656 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-767b99a1-1abf-4d43-9bef-74034663db7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:28.612231 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-767b99a1-1abf-4d43-9bef-74034663db7f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.116966 Jun 20 14:57:28.612869 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 324/660] 10.222.0.23 () {60 vars in 1315 bytes} [Mon Jun 20 14:57:28 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:57:28.615977 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-dbd464a5-b64a-4776-823e-3fc84213057a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:28.624013 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-dbd464a5-b64a-4776-823e-3fc84213057a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 200 len: 1365 microversion: 2.1 time: 0.203748 Jun 20 14:57:28.625327 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 337/661] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:28 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:57:29.638504 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=4 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:29.642914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1e341a49-2fc6-45dd-9024-6850b868cebc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:29.643509 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1e341a49-2fc6-45dd-9024-6850b868cebc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:29.649941 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1e341a49-2fc6-45dd-9024-6850b868cebc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:29.650374 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1e341a49-2fc6-45dd-9024-6850b868cebc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:29.651110 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1e341a49-2fc6-45dd-9024-6850b868cebc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:29.651530 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1e341a49-2fc6-45dd-9024-6850b868cebc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:29.870719 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1e341a49-2fc6-45dd-9024-6850b868cebc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:29.888084 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1e341a49-2fc6-45dd-9024-6850b868cebc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 200 len: 1365 microversion: 2.1 time: 0.250106 Jun 20 14:57:29.897589 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 325/662] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:29 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:29.911206 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-280198ac-a06f-4239-82c2-72ab57dce36e req-008c264b-5d04-48bd-927b-98d7e4c28220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf05798-c6d2-444f-bed3-1a30d8a8a1bb", "tag": "6a7393ac-776d-4cd4-9e00-be227b057942"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:29.915412 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=4 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:29.916197 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=22 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:29.923388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-280198ac-a06f-4239-82c2-72ab57dce36e req-008c264b-5d04-48bd-927b-98d7e4c28220 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:29.923829 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-280198ac-a06f-4239-82c2-72ab57dce36e req-008c264b-5d04-48bd-927b-98d7e4c28220 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:29.937105 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-280198ac-a06f-4239-82c2-72ab57dce36e req-008c264b-5d04-48bd-927b-98d7e4c28220 service nova] Creating event network-changed:6a7393ac-776d-4cd4-9e00-be227b057942 for instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb on hv-cinder-83697 Jun 20 14:57:29.943288 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-280198ac-a06f-4239-82c2-72ab57dce36e req-008c264b-5d04-48bd-927b-98d7e4c28220 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035523 Jun 20 14:57:29.944260 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 338/663] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:30.465419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-35b23e2e-5cde-466a-8384-6a5ad13c140d req-eec1da4d-1e86-4bac-9398-2bfffde2e5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a", "name": "network-vif-plugged", "status": "completed", "tag": "35e04bd3-d6a7-4435-9fb4-54ee749aff5b"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:30.473864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-35b23e2e-5cde-466a-8384-6a5ad13c140d req-eec1da4d-1e86-4bac-9398-2bfffde2e5f2 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:30.474511 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-35b23e2e-5cde-466a-8384-6a5ad13c140d req-eec1da4d-1e86-4bac-9398-2bfffde2e5f2 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:30.486753 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-35b23e2e-5cde-466a-8384-6a5ad13c140d req-eec1da4d-1e86-4bac-9398-2bfffde2e5f2 service nova] Creating event network-vif-plugged:35e04bd3-d6a7-4435-9fb4-54ee749aff5b for instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a on hv-cinder-83697 Jun 20 14:57:30.493504 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-35b23e2e-5cde-466a-8384-6a5ad13c140d req-eec1da4d-1e86-4bac-9398-2bfffde2e5f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031204 Jun 20 14:57:30.494124 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 326/664] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:30.904467 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ba001c0a-828e-471d-9412-68a2a4b99dc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:30.905203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ba001c0a-828e-471d-9412-68a2a4b99dc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:30.914370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba001c0a-828e-471d-9412-68a2a4b99dc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:30.914370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba001c0a-828e-471d-9412-68a2a4b99dc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:30.915023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba001c0a-828e-471d-9412-68a2a4b99dc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:30.915023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba001c0a-828e-471d-9412-68a2a4b99dc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:31.076707 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ba001c0a-828e-471d-9412-68a2a4b99dc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:31.084751 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ba001c0a-828e-471d-9412-68a2a4b99dc8 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 200 len: 1365 microversion: 2.1 time: 0.184304 Jun 20 14:57:31.085513 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 339/665] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:30 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:32.106530 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-21b60775-642b-4e1a-a3d0-0e16f065a4bc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:32.107217 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-21b60775-642b-4e1a-a3d0-0e16f065a4bc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:32.115075 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-21b60775-642b-4e1a-a3d0-0e16f065a4bc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:32.115515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-21b60775-642b-4e1a-a3d0-0e16f065a4bc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:32.116265 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-21b60775-642b-4e1a-a3d0-0e16f065a4bc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:32.116684 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-21b60775-642b-4e1a-a3d0-0e16f065a4bc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:32.268411 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-21b60775-642b-4e1a-a3d0-0e16f065a4bc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:57:32.275941 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-21b60775-642b-4e1a-a3d0-0e16f065a4bc tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 200 len: 1554 microversion: 2.1 time: 0.176946 Jun 20 14:57:32.276521 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 327/666] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:57:32 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:57:32.292400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e762f42f-4151-4cf2-9a72-61152062ad78 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:57:32.292975 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e762f42f-4151-4cf2-9a72-61152062ad78 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:57:32.299587 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e762f42f-4151-4cf2-9a72-61152062ad78 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:32.300035 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e762f42f-4151-4cf2-9a72-61152062ad78 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:32.300830 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e762f42f-4151-4cf2-9a72-61152062ad78 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:32.301265 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e762f42f-4151-4cf2-9a72-61152062ad78 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:32.381396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e762f42f-4151-4cf2-9a72-61152062ad78 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092922 Jun 20 14:57:32.381975 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 340/667] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 14:57:32 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:57:33.349426 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-1136b539-6baa-4b04-bd0a-1abb0e2f6d9c req-6762dbbd-98d4-4e56-9cd2-383d30dc78b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a", "tag": "35e04bd3-d6a7-4435-9fb4-54ee749aff5b"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:57:33.358085 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-1136b539-6baa-4b04-bd0a-1abb0e2f6d9c req-6762dbbd-98d4-4e56-9cd2-383d30dc78b6 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:57:33.358557 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-1136b539-6baa-4b04-bd0a-1abb0e2f6d9c req-6762dbbd-98d4-4e56-9cd2-383d30dc78b6 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:57:33.369521 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-1136b539-6baa-4b04-bd0a-1abb0e2f6d9c req-6762dbbd-98d4-4e56-9cd2-383d30dc78b6 service nova] Creating event network-changed:35e04bd3-d6a7-4435-9fb4-54ee749aff5b for instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a on hv-cinder-83697 Jun 20 14:57:33.375105 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-1136b539-6baa-4b04-bd0a-1abb0e2f6d9c req-6762dbbd-98d4-4e56-9cd2-383d30dc78b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028852 Jun 20 14:57:33.375906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 328/668] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:58:14.283706 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=10 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:14.284369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=30 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:14.288319 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-233a5a4f-d7ec-4336-a131-4150e34bc19b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:14.288836 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-233a5a4f-d7ec-4336-a131-4150e34bc19b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:14.295631 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-233a5a4f-d7ec-4336-a131-4150e34bc19b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:14.296078 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-233a5a4f-d7ec-4336-a131-4150e34bc19b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:14.296886 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-233a5a4f-d7ec-4336-a131-4150e34bc19b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:14.297318 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-233a5a4f-d7ec-4336-a131-4150e34bc19b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:14.321838 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-233a5a4f-d7ec-4336-a131-4150e34bc19b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb/ips" status: 200 len: 152 microversion: 2.20 time: 0.039994 Jun 20 14:58:14.322406 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 341/669] 10.222.0.23 () {60 vars in 1288 bytes} [Mon Jun 20 14:58:14 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:58:16.135849 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-998be890-677e-497e-b691-b4881c6beb71 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:58:16.136410 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-998be890-677e-497e-b691-b4881c6beb71 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:16.138817 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=68 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:16.139451 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=50 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:16.145875 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-998be890-677e-497e-b691-b4881c6beb71 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:16.146309 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-998be890-677e-497e-b691-b4881c6beb71 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:16.147073 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-998be890-677e-497e-b691-b4881c6beb71 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:16.147500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-998be890-677e-497e-b691-b4881c6beb71 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:16.170439 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-998be890-677e-497e-b691-b4881c6beb71 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lazy-loading 'flavor' on Instance uuid aaf05798-c6d2-444f-bed3-1a30d8a8a1bb {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:58:16.482772 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-998be890-677e-497e-b691-b4881c6beb71 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "POST /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb/action" status: 202 len: 0 microversion: 2.20 time: 0.351196 Jun 20 14:58:16.483446 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 329/670] 10.222.0.23 () {62 vars in 1318 bytes} [Mon Jun 20 14:58:16 2022] POST /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:58:16.492395 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-a927cb4c-c4e3-4531-b3e7-6716e0e5f84a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:16.492983 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-a927cb4c-c4e3-4531-b3e7-6716e0e5f84a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:16.499932 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a927cb4c-c4e3-4531-b3e7-6716e0e5f84a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:16.500353 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a927cb4c-c4e3-4531-b3e7-6716e0e5f84a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:16.501135 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a927cb4c-c4e3-4531-b3e7-6716e0e5f84a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:16.501568 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a927cb4c-c4e3-4531-b3e7-6716e0e5f84a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:16.641684 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a927cb4c-c4e3-4531-b3e7-6716e0e5f84a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:16.654840 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a927cb4c-c4e3-4531-b3e7-6716e0e5f84a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:16.657207 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a927cb4c-c4e3-4531-b3e7-6716e0e5f84a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:16.659033 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-a927cb4c-c4e3-4531-b3e7-6716e0e5f84a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.170750 Jun 20 14:58:16.660044 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 342/671] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:16 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:17.680513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0769c4d4-48ae-4861-932a-3be8d9684eae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:17.681211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-0769c4d4-48ae-4861-932a-3be8d9684eae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:17.688645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0769c4d4-48ae-4861-932a-3be8d9684eae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:17.689129 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0769c4d4-48ae-4861-932a-3be8d9684eae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:17.689912 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0769c4d4-48ae-4861-932a-3be8d9684eae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:17.690340 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0769c4d4-48ae-4861-932a-3be8d9684eae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:17.717611 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e5f77720-e664-488f-996c-206f2041f002 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:17.718351 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e5f77720-e664-488f-996c-206f2041f002 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:17.725630 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e5f77720-e664-488f-996c-206f2041f002 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:17.726074 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e5f77720-e664-488f-996c-206f2041f002 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:17.726837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e5f77720-e664-488f-996c-206f2041f002 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:17.727252 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e5f77720-e664-488f-996c-206f2041f002 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:17.753366 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e5f77720-e664-488f-996c-206f2041f002 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a/ips" status: 200 len: 148 microversion: 2.1 time: 0.039629 Jun 20 14:58:17.753935 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 343/672] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 14:58:17 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:58:17.834863 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0769c4d4-48ae-4861-932a-3be8d9684eae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:17.843570 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0769c4d4-48ae-4861-932a-3be8d9684eae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:17.845359 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0769c4d4-48ae-4861-932a-3be8d9684eae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:17.846759 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0769c4d4-48ae-4861-932a-3be8d9684eae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.172148 Jun 20 14:58:17.847494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 330/673] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:17 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:18.872761 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6e168587-af2b-4c40-9f54-1cf9c4b2e836 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:18.873390 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-6e168587-af2b-4c40-9f54-1cf9c4b2e836 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:18.880807 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6e168587-af2b-4c40-9f54-1cf9c4b2e836 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:18.881255 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6e168587-af2b-4c40-9f54-1cf9c4b2e836 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:18.882010 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6e168587-af2b-4c40-9f54-1cf9c4b2e836 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:18.882436 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6e168587-af2b-4c40-9f54-1cf9c4b2e836 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:19.018165 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6e168587-af2b-4c40-9f54-1cf9c4b2e836 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:19.031359 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6e168587-af2b-4c40-9f54-1cf9c4b2e836 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:19.033573 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6e168587-af2b-4c40-9f54-1cf9c4b2e836 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:19.035183 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6e168587-af2b-4c40-9f54-1cf9c4b2e836 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.166579 Jun 20 14:58:19.035749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 344/674] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:18 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:20.052831 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-5549eb50-af67-4db3-a246-0b34f63ba3f7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:20.053436 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-5549eb50-af67-4db3-a246-0b34f63ba3f7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:20.060349 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5549eb50-af67-4db3-a246-0b34f63ba3f7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:20.061131 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5549eb50-af67-4db3-a246-0b34f63ba3f7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:20.061874 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5549eb50-af67-4db3-a246-0b34f63ba3f7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:20.062298 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5549eb50-af67-4db3-a246-0b34f63ba3f7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:20.194531 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-5549eb50-af67-4db3-a246-0b34f63ba3f7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:20.202563 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-5549eb50-af67-4db3-a246-0b34f63ba3f7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:20.204054 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-5549eb50-af67-4db3-a246-0b34f63ba3f7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:20.205271 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-5549eb50-af67-4db3-a246-0b34f63ba3f7 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.156518 Jun 20 14:58:20.205837 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 331/675] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:20 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:21.225856 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9629ca00-9b4a-4c96-b17d-14dcc948240c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dde4ba00-5507-4fc3-aa34-4f8b9e213d29"}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:58:21.226972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9629ca00-9b4a-4c96-b17d-14dcc948240c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:21.229377 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-35a66989-1e0f-4dd5-becc-f03750194a51 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:21.230016 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-35a66989-1e0f-4dd5-becc-f03750194a51 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:21.233918 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9629ca00-9b4a-4c96-b17d-14dcc948240c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:21.234382 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9629ca00-9b4a-4c96-b17d-14dcc948240c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:21.235143 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9629ca00-9b4a-4c96-b17d-14dcc948240c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:21.235571 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9629ca00-9b4a-4c96-b17d-14dcc948240c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:21.236493 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-35a66989-1e0f-4dd5-becc-f03750194a51 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:21.236975 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-35a66989-1e0f-4dd5-becc-f03750194a51 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:21.237719 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-35a66989-1e0f-4dd5-becc-f03750194a51 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:21.238149 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-35a66989-1e0f-4dd5-becc-f03750194a51 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:21.374240 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-35a66989-1e0f-4dd5-becc-f03750194a51 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:21.383352 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-35a66989-1e0f-4dd5-becc-f03750194a51 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:21.384980 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-35a66989-1e0f-4dd5-becc-f03750194a51 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:21.386236 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-35a66989-1e0f-4dd5-becc-f03750194a51 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.160723 Jun 20 14:58:21.386909 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 332/676] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:21 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:21.492654 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9629ca00-9b4a-4c96-b17d-14dcc948240c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "POST /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270768 Jun 20 14:58:21.493378 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 345/677] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 14:58:21 2022] POST /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:58:22.407695 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-354ebfda-931e-4d88-be8f-2339c002501d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:22.408377 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-354ebfda-931e-4d88-be8f-2339c002501d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:22.419609 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-354ebfda-931e-4d88-be8f-2339c002501d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:22.420330 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-354ebfda-931e-4d88-be8f-2339c002501d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:22.421608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-354ebfda-931e-4d88-be8f-2339c002501d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:22.422274 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-354ebfda-931e-4d88-be8f-2339c002501d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:22.557888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-354ebfda-931e-4d88-be8f-2339c002501d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:22.566611 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-354ebfda-931e-4d88-be8f-2339c002501d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:22.568107 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-354ebfda-931e-4d88-be8f-2339c002501d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:22.569306 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-354ebfda-931e-4d88-be8f-2339c002501d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.168079 Jun 20 14:58:22.570067 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 333/678] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:22 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:23.593222 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-4d70ab95-58ba-4e18-9116-f821d3b68b1d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:23.594338 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-4d70ab95-58ba-4e18-9116-f821d3b68b1d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:23.602057 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4d70ab95-58ba-4e18-9116-f821d3b68b1d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:23.602501 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4d70ab95-58ba-4e18-9116-f821d3b68b1d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:23.603251 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4d70ab95-58ba-4e18-9116-f821d3b68b1d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:23.603696 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4d70ab95-58ba-4e18-9116-f821d3b68b1d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:23.736097 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-4d70ab95-58ba-4e18-9116-f821d3b68b1d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:23.744554 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-4d70ab95-58ba-4e18-9116-f821d3b68b1d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:23.746036 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-4d70ab95-58ba-4e18-9116-f821d3b68b1d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:23.747193 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-4d70ab95-58ba-4e18-9116-f821d3b68b1d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.161894 Jun 20 14:58:23.747753 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 346/679] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:23 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:24.769829 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d59bb083-3349-42ae-952f-33db8e81bb36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:24.770808 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-d59bb083-3349-42ae-952f-33db8e81bb36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:24.781962 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d59bb083-3349-42ae-952f-33db8e81bb36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:24.782696 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d59bb083-3349-42ae-952f-33db8e81bb36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:24.783993 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d59bb083-3349-42ae-952f-33db8e81bb36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:24.784752 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d59bb083-3349-42ae-952f-33db8e81bb36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:24.928759 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d59bb083-3349-42ae-952f-33db8e81bb36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:24.937428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d59bb083-3349-42ae-952f-33db8e81bb36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:24.938950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d59bb083-3349-42ae-952f-33db8e81bb36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:24.940151 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d59bb083-3349-42ae-952f-33db8e81bb36 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.177403 Jun 20 14:58:24.940804 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 334/680] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:24 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:25.958563 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2e30ea80-3782-46fb-9f38-8686f4e52a31 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:25.959241 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-2e30ea80-3782-46fb-9f38-8686f4e52a31 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:25.966988 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2e30ea80-3782-46fb-9f38-8686f4e52a31 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:25.967463 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2e30ea80-3782-46fb-9f38-8686f4e52a31 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:25.968587 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2e30ea80-3782-46fb-9f38-8686f4e52a31 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:25.969292 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2e30ea80-3782-46fb-9f38-8686f4e52a31 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:26.121409 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-2e30ea80-3782-46fb-9f38-8686f4e52a31 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:26.130569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-2e30ea80-3782-46fb-9f38-8686f4e52a31 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:26.132021 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-2e30ea80-3782-46fb-9f38-8686f4e52a31 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:26.133242 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-2e30ea80-3782-46fb-9f38-8686f4e52a31 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.178684 Jun 20 14:58:26.133824 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 347/681] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:25 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:27.158450 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1379742b-a38b-46cf-877d-d7959892ff3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:27.159793 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1379742b-a38b-46cf-877d-d7959892ff3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:27.168758 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1379742b-a38b-46cf-877d-d7959892ff3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:27.169206 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1379742b-a38b-46cf-877d-d7959892ff3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:27.170152 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1379742b-a38b-46cf-877d-d7959892ff3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:27.170652 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1379742b-a38b-46cf-877d-d7959892ff3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:27.305722 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1379742b-a38b-46cf-877d-d7959892ff3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:27.314490 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1379742b-a38b-46cf-877d-d7959892ff3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:27.315980 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1379742b-a38b-46cf-877d-d7959892ff3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:27.317249 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1379742b-a38b-46cf-877d-d7959892ff3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.167636 Jun 20 14:58:27.317868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 335/682] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:27 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:28.339672 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d0d1dc24-b7ea-4b66-84ad-9f4639fcf55a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:28.340617 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d0d1dc24-b7ea-4b66-84ad-9f4639fcf55a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:28.351446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d0d1dc24-b7ea-4b66-84ad-9f4639fcf55a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:28.352199 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d0d1dc24-b7ea-4b66-84ad-9f4639fcf55a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:28.353499 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d0d1dc24-b7ea-4b66-84ad-9f4639fcf55a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:28.354212 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d0d1dc24-b7ea-4b66-84ad-9f4639fcf55a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:28.490033 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d0d1dc24-b7ea-4b66-84ad-9f4639fcf55a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:28.498366 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d0d1dc24-b7ea-4b66-84ad-9f4639fcf55a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:28.499901 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d0d1dc24-b7ea-4b66-84ad-9f4639fcf55a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:28.501083 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d0d1dc24-b7ea-4b66-84ad-9f4639fcf55a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.168084 Jun 20 14:58:28.501653 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 348/683] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:28 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:29.121550 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f1df4731-235c-43c7-842c-e473f976c56a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:29.122070 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f1df4731-235c-43c7-842c-e473f976c56a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:29.129102 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1df4731-235c-43c7-842c-e473f976c56a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:29.129329 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1df4731-235c-43c7-842c-e473f976c56a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:29.130440 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1df4731-235c-43c7-842c-e473f976c56a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:29.130904 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1df4731-235c-43c7-842c-e473f976c56a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:29.223204 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-f1df4731-235c-43c7-842c-e473f976c56a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lazy-loading 'services' on Instance uuid d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:58:29.301745 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f1df4731-235c-43c7-842c-e473f976c56a tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a/os-volume_attachments/dde4ba00-5507-4fc3-aa34-4f8b9e213d29" status: 202 len: 0 microversion: 2.1 time: 0.183863 Jun 20 14:58:29.302608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 336/684] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 14:58:29 2022] DELETE /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a/os-volume_attachments/dde4ba00-5507-4fc3-aa34-4f8b9e213d29 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 14:58:29.311166 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-36b1c3b2-392c-4e15-91a0-3db8f90cb7c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:29.312204 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-36b1c3b2-392c-4e15-91a0-3db8f90cb7c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:29.318633 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-36b1c3b2-392c-4e15-91a0-3db8f90cb7c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:29.319047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-36b1c3b2-392c-4e15-91a0-3db8f90cb7c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:29.319848 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-36b1c3b2-392c-4e15-91a0-3db8f90cb7c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:29.320313 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-36b1c3b2-392c-4e15-91a0-3db8f90cb7c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:29.359842 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-36b1c3b2-392c-4e15-91a0-3db8f90cb7c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052916 Jun 20 14:58:29.361273 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 349/685] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 14:58:29 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:58:29.524674 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f6209060-8bd0-4f8b-a3bb-c850f6f55c03 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:29.525929 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f6209060-8bd0-4f8b-a3bb-c850f6f55c03 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:29.536463 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f6209060-8bd0-4f8b-a3bb-c850f6f55c03 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:29.536949 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f6209060-8bd0-4f8b-a3bb-c850f6f55c03 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:29.537706 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f6209060-8bd0-4f8b-a3bb-c850f6f55c03 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:29.538148 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f6209060-8bd0-4f8b-a3bb-c850f6f55c03 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:29.675019 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f6209060-8bd0-4f8b-a3bb-c850f6f55c03 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:29.684996 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f6209060-8bd0-4f8b-a3bb-c850f6f55c03 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:29.687520 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f6209060-8bd0-4f8b-a3bb-c850f6f55c03 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:29.688921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f6209060-8bd0-4f8b-a3bb-c850f6f55c03 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.171292 Jun 20 14:58:29.689578 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 337/686] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:29 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:30.375772 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-33f204a2-4f93-4a56-830e-847eb0982640 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:30.377161 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-33f204a2-4f93-4a56-830e-847eb0982640 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:30.388275 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-33f204a2-4f93-4a56-830e-847eb0982640 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:30.389119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-33f204a2-4f93-4a56-830e-847eb0982640 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:30.390359 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-33f204a2-4f93-4a56-830e-847eb0982640 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:30.391057 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-33f204a2-4f93-4a56-830e-847eb0982640 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:30.421794 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-33f204a2-4f93-4a56-830e-847eb0982640 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052745 Jun 20 14:58:30.422346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 350/687] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 14:58:30 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 14:58:30.491965 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f1433a89-bb49-4bb3-b5fc-6c8266ede25d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:30.492501 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f1433a89-bb49-4bb3-b5fc-6c8266ede25d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:30.499158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1433a89-bb49-4bb3-b5fc-6c8266ede25d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:30.499600 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1433a89-bb49-4bb3-b5fc-6c8266ede25d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:30.500358 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1433a89-bb49-4bb3-b5fc-6c8266ede25d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:30.500914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1433a89-bb49-4bb3-b5fc-6c8266ede25d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:30.527493 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f1433a89-bb49-4bb3-b5fc-6c8266ede25d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 14:58:30.607216 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f1433a89-bb49-4bb3-b5fc-6c8266ede25d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 204 len: 0 microversion: 2.1 time: 0.119210 Jun 20 14:58:30.607792 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 338/688] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:58:30 2022] DELETE /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:58:30.616343 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ae1ea54d-09cb-433e-b694-b64b8c96efa5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:30.616976 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ae1ea54d-09cb-433e-b694-b64b8c96efa5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:30.622960 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ae1ea54d-09cb-433e-b694-b64b8c96efa5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:30.623399 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ae1ea54d-09cb-433e-b694-b64b8c96efa5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:30.624140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ae1ea54d-09cb-433e-b694-b64b8c96efa5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:30.624560 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ae1ea54d-09cb-433e-b694-b64b8c96efa5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:30.708514 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-53be7d5d-ef98-4db5-85d5-7337b56eef18 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:30.709166 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-53be7d5d-ef98-4db5-85d5-7337b56eef18 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:30.715458 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-53be7d5d-ef98-4db5-85d5-7337b56eef18 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:30.715893 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-53be7d5d-ef98-4db5-85d5-7337b56eef18 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:30.716653 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-53be7d5d-ef98-4db5-85d5-7337b56eef18 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:30.717107 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-53be7d5d-ef98-4db5-85d5-7337b56eef18 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:30.764095 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ae1ea54d-09cb-433e-b694-b64b8c96efa5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:30.771683 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ae1ea54d-09cb-433e-b694-b64b8c96efa5 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 200 len: 1678 microversion: 2.1 time: 0.159529 Jun 20 14:58:30.772253 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 351/689] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:58:30 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:58:30.843871 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-53be7d5d-ef98-4db5-85d5-7337b56eef18 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:30.852341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-53be7d5d-ef98-4db5-85d5-7337b56eef18 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:30.853871 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-53be7d5d-ef98-4db5-85d5-7337b56eef18 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:30.855025 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-53be7d5d-ef98-4db5-85d5-7337b56eef18 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.151336 Jun 20 14:58:30.855613 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 339/690] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:30 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:58:31.790594 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0120e691-88d8-4e74-943e-6237b01947bb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:31.791452 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-0120e691-88d8-4e74-943e-6237b01947bb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:31.800536 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0120e691-88d8-4e74-943e-6237b01947bb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:31.801169 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0120e691-88d8-4e74-943e-6237b01947bb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:31.802546 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0120e691-88d8-4e74-943e-6237b01947bb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:31.803315 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0120e691-88d8-4e74-943e-6237b01947bb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:31.873454 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-a77a602c-1819-45c5-9b0c-8262b68228e9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:31.874155 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-a77a602c-1819-45c5-9b0c-8262b68228e9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:31.881502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a77a602c-1819-45c5-9b0c-8262b68228e9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:31.881947 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a77a602c-1819-45c5-9b0c-8262b68228e9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:31.882712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a77a602c-1819-45c5-9b0c-8262b68228e9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:31.883146 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a77a602c-1819-45c5-9b0c-8262b68228e9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:31.947183 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0120e691-88d8-4e74-943e-6237b01947bb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:31.955379 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0120e691-88d8-4e74-943e-6237b01947bb tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 200 len: 1678 microversion: 2.1 time: 0.169788 Jun 20 14:58:31.955971 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 352/691] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:58:31 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:58:32.370798 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-a77a602c-1819-45c5-9b0c-8262b68228e9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:32.379679 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-a77a602c-1819-45c5-9b0c-8262b68228e9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:32.381316 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-a77a602c-1819-45c5-9b0c-8262b68228e9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:32.382472 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-a77a602c-1819-45c5-9b0c-8262b68228e9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.513059 Jun 20 14:58:32.383065 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 340/692] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:31 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:32.973503 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ad66c966-236a-4f7e-ac69-c287e135925f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:32.974115 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ad66c966-236a-4f7e-ac69-c287e135925f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:32.981099 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ad66c966-236a-4f7e-ac69-c287e135925f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:32.981538 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ad66c966-236a-4f7e-ac69-c287e135925f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:32.982315 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ad66c966-236a-4f7e-ac69-c287e135925f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:32.982723 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ad66c966-236a-4f7e-ac69-c287e135925f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:33.046183 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ad66c966-236a-4f7e-ac69-c287e135925f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87c3f39c0bed4fadbc8a556c857baf4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cbc0c846c4a528fccd85b0b8ab4d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:33.065208 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ad66c966-236a-4f7e-ac69-c287e135925f tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 200 len: 1610 microversion: 2.1 time: 0.095528 Jun 20 14:58:33.066824 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 353/693] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:58:32 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 1610 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:58:33.243036 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-2ff6e03e-2075-462f-bc9c-7a289e18dc9c req-0f1d774d-822e-4931-9146-e6911a8a24db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a", "name": "network-vif-deleted", "tag": "35e04bd3-d6a7-4435-9fb4-54ee749aff5b"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:58:33.251652 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-2ff6e03e-2075-462f-bc9c-7a289e18dc9c req-0f1d774d-822e-4931-9146-e6911a8a24db service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:33.252130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-2ff6e03e-2075-462f-bc9c-7a289e18dc9c req-0f1d774d-822e-4931-9146-e6911a8a24db service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:33.256250 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:33.264926 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-2ff6e03e-2075-462f-bc9c-7a289e18dc9c req-0f1d774d-822e-4931-9146-e6911a8a24db service nova] Creating event network-vif-deleted:35e04bd3-d6a7-4435-9fb4-54ee749aff5b for instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a on hv-cinder-83697 Jun 20 14:58:33.271522 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-2ff6e03e-2075-462f-bc9c-7a289e18dc9c req-0f1d774d-822e-4931-9146-e6911a8a24db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166997 Jun 20 14:58:33.272392 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 341/694] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:58:33.400050 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-a5130e0e-e3a3-4a34-a809-f365abddfc3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:33.400686 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-a5130e0e-e3a3-4a34-a809-f365abddfc3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:33.407643 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a5130e0e-e3a3-4a34-a809-f365abddfc3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:33.408081 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a5130e0e-e3a3-4a34-a809-f365abddfc3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:33.408955 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a5130e0e-e3a3-4a34-a809-f365abddfc3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:33.409314 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a5130e0e-e3a3-4a34-a809-f365abddfc3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:33.569196 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a5130e0e-e3a3-4a34-a809-f365abddfc3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:33.577731 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a5130e0e-e3a3-4a34-a809-f365abddfc3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:33.579909 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a5130e0e-e3a3-4a34-a809-f365abddfc3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:33.581125 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-a5130e0e-e3a3-4a34-a809-f365abddfc3a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1743 microversion: 2.20 time: 0.185113 Jun 20 14:58:33.581976 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 354/695] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:33 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:34.084755 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-754d1966-d3bd-4204-9697-9a15ff2a9615 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:34.085460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-754d1966-d3bd-4204-9697-9a15ff2a9615 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:34.092297 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-754d1966-d3bd-4204-9697-9a15ff2a9615 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:34.092795 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-754d1966-d3bd-4204-9697-9a15ff2a9615 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:34.093575 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-754d1966-d3bd-4204-9697-9a15ff2a9615 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:34.094217 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-754d1966-d3bd-4204-9697-9a15ff2a9615 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:34.108482 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-754d1966-d3bd-4204-9697-9a15ff2a9615 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] HTTP exception thrown: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-754d1966-d3bd-4204-9697-9a15ff2a9615 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Request method failure captured: Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a HTTP/1.1 Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImbz0WxD1k9ycjcFtONQioapmstd9ALeY-XOY9KWzwZRC4BzRHKOJNKseVz_SOU8X1kqkeZceHCAJurCXmzp5osSOaO2_Ehpi_atwxfvtaZZDfF13_WZ-v9TPM1dlOrXp8wu-OjE4ErE1kdNfUTWsTDESJSRneLOLv_h39cbJpuqhQ Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:58:34.110172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:58:34.111661 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}] Jun 20 14:58:34.111661 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:34.111661 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:34.111661 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:34.111661 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:34.111661 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:58:34.111661 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:58:34.111661 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 87c3f39c0bed4fadbc8a556c857baf4a Jun 20 14:58:34.111661 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:34.111661 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:58:34.111661 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. Jun 20 14:58:34.111661 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': 'd8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a'} Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:58:34.112441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. Jun 20 14:58:34.113743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:34.114933 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-754d1966-d3bd-4204-9697-9a15ff2a9615 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Returning 404 to user: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:58:34.114933 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-754d1966-d3bd-4204-9697-9a15ff2a9615 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 404 len: 111 microversion: 2.1 time: 0.031714 Jun 20 14:58:34.114933 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 342/696] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:58:34 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:58:34.120739 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-51a592a6-cb27-4561-927f-7e1c5b8ab58e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '.version_select at 0x7fce5098fd30>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:34.141221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-51a592a6-cb27-4561-927f-7e1c5b8ab58e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-13715157" status: 202 len: 0 microversion: 2.1 time: 0.024170 Jun 20 14:58:34.141788 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 355/697] 10.222.0.23 () {58 vars in 1214 bytes} [Mon Jun 20 14:58:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-13715157 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 14:58:34.603164 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0ef1eb90-c92d-422c-be54-2bfa376f2511 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:34.604393 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-0ef1eb90-c92d-422c-be54-2bfa376f2511 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:34.616934 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0ef1eb90-c92d-422c-be54-2bfa376f2511 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:34.617603 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0ef1eb90-c92d-422c-be54-2bfa376f2511 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:34.620231 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0ef1eb90-c92d-422c-be54-2bfa376f2511 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:34.621109 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0ef1eb90-c92d-422c-be54-2bfa376f2511 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:34.875241 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0ef1eb90-c92d-422c-be54-2bfa376f2511 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:34.889674 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0ef1eb90-c92d-422c-be54-2bfa376f2511 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:34.892582 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0ef1eb90-c92d-422c-be54-2bfa376f2511 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:34.895041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0ef1eb90-c92d-422c-be54-2bfa376f2511 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1738 microversion: 2.20 time: 0.297934 Jun 20 14:58:34.896740 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 343/698] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:34 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1738 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:58:35.919039 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7df43192-e4d2-4690-965d-483603b8ce8d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:35.919613 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7df43192-e4d2-4690-965d-483603b8ce8d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:35.927398 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7df43192-e4d2-4690-965d-483603b8ce8d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:35.927988 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7df43192-e4d2-4690-965d-483603b8ce8d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:35.928919 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7df43192-e4d2-4690-965d-483603b8ce8d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:35.929588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7df43192-e4d2-4690-965d-483603b8ce8d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:36.073909 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7df43192-e4d2-4690-965d-483603b8ce8d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:36.081973 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7df43192-e4d2-4690-965d-483603b8ce8d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:36.083609 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7df43192-e4d2-4690-965d-483603b8ce8d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:36.084875 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7df43192-e4d2-4690-965d-483603b8ce8d tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1738 microversion: 2.20 time: 0.173752 Jun 20 14:58:36.095219 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 356/699] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:35 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:36.145006 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1c159125-a1c9-4c7b-a17a-5156cf6aa2db tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:36.145856 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1c159125-a1c9-4c7b-a17a-5156cf6aa2db tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:36.152760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1c159125-a1c9-4c7b-a17a-5156cf6aa2db tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:36.153306 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1c159125-a1c9-4c7b-a17a-5156cf6aa2db tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:36.154316 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1c159125-a1c9-4c7b-a17a-5156cf6aa2db tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:36.154840 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1c159125-a1c9-4c7b-a17a-5156cf6aa2db tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:36.169554 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-1c159125-a1c9-4c7b-a17a-5156cf6aa2db tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] HTTP exception thrown: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1c159125-a1c9-4c7b-a17a-5156cf6aa2db tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Request method failure captured: Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: DELETE /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a HTTP/1.1 Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImbz0WxD1k9ycjcFtONQioapmstd9ALeY-XOY9KWzwZRC4BzRHKOJNKseVz_SOU8X1kqkeZceHCAJurCXmzp5osSOaO2_Ehpi_atwxfvtaZZDfF13_WZ-v9TPM1dlOrXp8wu-OjE4ErE1kdNfUTWsTDESJSRneLOLv_h39cbJpuqhQ Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:58:36.171302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:58:36.172868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}] Jun 20 14:58:36.172868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:36.172868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:36.172868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:36.172868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:36.172868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:58:36.172868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:58:36.172868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 87c3f39c0bed4fadbc8a556c857baf4a Jun 20 14:58:36.172868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:36.172868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:58:36.172868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. Jun 20 14:58:36.172868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': 'd8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a'} Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:58:36.173902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. Jun 20 14:58:36.175322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:36.176733 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1c159125-a1c9-4c7b-a17a-5156cf6aa2db tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Returning 404 to user: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:58:36.176733 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1c159125-a1c9-4c7b-a17a-5156cf6aa2db tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 404 len: 111 microversion: 2.1 time: 0.033368 Jun 20 14:58:36.176733 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 344/700] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:58:36 2022] DELETE /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 14:58:36.183898 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d4340051-9886-414e-8835-04a1165f614e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:36.184542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d4340051-9886-414e-8835-04a1165f614e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:36.192797 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d4340051-9886-414e-8835-04a1165f614e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:36.193215 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d4340051-9886-414e-8835-04a1165f614e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:36.193991 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d4340051-9886-414e-8835-04a1165f614e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:36.194421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d4340051-9886-414e-8835-04a1165f614e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:36.208634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-d4340051-9886-414e-8835-04a1165f614e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] HTTP exception thrown: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d4340051-9886-414e-8835-04a1165f614e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Request method failure captured: Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a HTTP/1.1 Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImbz0WxD1k9ycjcFtONQioapmstd9ALeY-XOY9KWzwZRC4BzRHKOJNKseVz_SOU8X1kqkeZceHCAJurCXmzp5osSOaO2_Ehpi_atwxfvtaZZDfF13_WZ-v9TPM1dlOrXp8wu-OjE4ErE1kdNfUTWsTDESJSRneLOLv_h39cbJpuqhQ Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:58:36.210322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:58:36.211961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}] Jun 20 14:58:36.211961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:36.211961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:36.211961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:36.211961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:36.211961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:58:36.211961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:58:36.211961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 87c3f39c0bed4fadbc8a556c857baf4a Jun 20 14:58:36.211961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:36.211961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:58:36.211961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. Jun 20 14:58:36.211961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': 'd8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a'} Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:58:36.212802 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. Jun 20 14:58:36.214177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:36.215415 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d4340051-9886-414e-8835-04a1165f614e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Returning 404 to user: Instance d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:58:36.215415 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d4340051-9886-414e-8835-04a1165f614e tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a" status: 404 len: 111 microversion: 2.1 time: 0.031724 Jun 20 14:58:36.215415 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 357/701] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:58:36 2022] GET /compute/v2.1/servers/d8b9b249-3f96-4fe9-b1cb-4fd4b2269f5a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:58:36.700139 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-9bea4e64-d272-4e66-aa55-7a12884ec981 req-6f61fe51-750a-466d-bede-06a96d0a51ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf05798-c6d2-444f-bed3-1a30d8a8a1bb", "name": "network-vif-plugged", "status": "completed", "tag": "6a7393ac-776d-4cd4-9e00-be227b057942"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:58:36.709249 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-9bea4e64-d272-4e66-aa55-7a12884ec981 req-6f61fe51-750a-466d-bede-06a96d0a51ce service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:36.711571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-9bea4e64-d272-4e66-aa55-7a12884ec981 req-6f61fe51-750a-466d-bede-06a96d0a51ce service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:36.726231 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-9bea4e64-d272-4e66-aa55-7a12884ec981 req-6f61fe51-750a-466d-bede-06a96d0a51ce service nova] Creating event network-vif-plugged:6a7393ac-776d-4cd4-9e00-be227b057942 for instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb on hv-cinder-83697 Jun 20 14:58:36.734270 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-9bea4e64-d272-4e66-aa55-7a12884ec981 req-6f61fe51-750a-466d-bede-06a96d0a51ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112068 Jun 20 14:58:36.734884 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 345/702] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:58:37.104242 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3a636aaf-bac0-4c7d-9854-5dafebc16291 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:37.105000 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3a636aaf-bac0-4c7d-9854-5dafebc16291 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:37.118762 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3a636aaf-bac0-4c7d-9854-5dafebc16291 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:37.119197 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3a636aaf-bac0-4c7d-9854-5dafebc16291 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:37.119960 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3a636aaf-bac0-4c7d-9854-5dafebc16291 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:37.120383 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3a636aaf-bac0-4c7d-9854-5dafebc16291 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:37.143286 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:37.282162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3a636aaf-bac0-4c7d-9854-5dafebc16291 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:37.291748 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3a636aaf-bac0-4c7d-9854-5dafebc16291 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:37.294324 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3a636aaf-bac0-4c7d-9854-5dafebc16291 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:37.296376 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3a636aaf-bac0-4c7d-9854-5dafebc16291 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1738 microversion: 2.20 time: 0.196085 Jun 20 14:58:37.307681 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 358/703] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:37 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:37.365339 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1ac13f29-1d2e-49c3-966f-028d4f027688 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:37.366933 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1ac13f29-1d2e-49c3-966f-028d4f027688 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:37.375386 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1ac13f29-1d2e-49c3-966f-028d4f027688 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:37.376101 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1ac13f29-1d2e-49c3-966f-028d4f027688 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:37.377078 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1ac13f29-1d2e-49c3-966f-028d4f027688 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:37.377659 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1ac13f29-1d2e-49c3-966f-028d4f027688 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:37.399696 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-1ac13f29-1d2e-49c3-966f-028d4f027688 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] HTTP exception thrown: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1ac13f29-1d2e-49c3-966f-028d4f027688 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Request method failure captured: Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: DELETE /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac HTTP/1.1 Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImbz0WxD1k9ycjcFtONQioapmstd9ALeY-XOY9KWzwZRC4BzRHKOJNKseVz_SOU8X1kqkeZceHCAJurCXmzp5osSOaO2_Ehpi_atwxfvtaZZDfF13_WZ-v9TPM1dlOrXp8wu-OjE4ErE1kdNfUTWsTDESJSRneLOLv_h39cbJpuqhQ Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:58:37.401760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:58:37.403199 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}] Jun 20 14:58:37.403199 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:37.403199 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:37.403199 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:37.403199 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:37.403199 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:58:37.403199 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:58:37.403199 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 87c3f39c0bed4fadbc8a556c857baf4a Jun 20 14:58:37.403199 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:37.403199 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:58:37.403199 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. Jun 20 14:58:37.403199 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': '4dc2b001-2afc-4387-bc75-f9a40d79d9ac'} Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:58:37.403921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. Jun 20 14:58:37.405223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.407256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1ac13f29-1d2e-49c3-966f-028d4f027688 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Returning 404 to user: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:58:37.407256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1ac13f29-1d2e-49c3-966f-028d4f027688 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 404 len: 111 microversion: 2.1 time: 0.042656 Jun 20 14:58:37.407256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 346/704] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:58:37 2022] DELETE /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:58:37.413755 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-401b2746-8d75-4af5-9847-262848b6f72c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:37.414379 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-401b2746-8d75-4af5-9847-262848b6f72c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 4dc2b001-2afc-4387-bc75-f9a40d79d9ac] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:37.421306 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-401b2746-8d75-4af5-9847-262848b6f72c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:37.421756 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-401b2746-8d75-4af5-9847-262848b6f72c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:37.422544 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-401b2746-8d75-4af5-9847-262848b6f72c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:37.422965 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-401b2746-8d75-4af5-9847-262848b6f72c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:37.441800 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-401b2746-8d75-4af5-9847-262848b6f72c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] HTTP exception thrown: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-401b2746-8d75-4af5-9847-262848b6f72c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Request method failure captured: Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac HTTP/1.1 Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImbz0WxD1k9ycjcFtONQioapmstd9ALeY-XOY9KWzwZRC4BzRHKOJNKseVz_SOU8X1kqkeZceHCAJurCXmzp5osSOaO2_Ehpi_atwxfvtaZZDfF13_WZ-v9TPM1dlOrXp8wu-OjE4ErE1kdNfUTWsTDESJSRneLOLv_h39cbJpuqhQ Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:58:37.444147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:58:37.445913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}] Jun 20 14:58:37.445913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:37.445913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:37.445913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:37.445913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:37.445913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:58:37.445913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:58:37.445913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 87c3f39c0bed4fadbc8a556c857baf4a Jun 20 14:58:37.445913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:37.445913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:58:37.445913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. Jun 20 14:58:37.445913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '4dc2b001-2afc-4387-bc75-f9a40d79d9ac'} Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:58:37.447396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. Jun 20 14:58:37.448902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.450199 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-401b2746-8d75-4af5-9847-262848b6f72c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Returning 404 to user: Instance 4dc2b001-2afc-4387-bc75-f9a40d79d9ac could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:58:37.450199 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-401b2746-8d75-4af5-9847-262848b6f72c tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac" status: 404 len: 111 microversion: 2.1 time: 0.036274 Jun 20 14:58:37.450199 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 359/705] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:58:37 2022] GET /compute/v2.1/servers/4dc2b001-2afc-4387-bc75-f9a40d79d9ac => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:58:37.455745 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-63db7c05-32da-4271-b859-d8754f80d4e7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:37.456467 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-63db7c05-32da-4271-b859-d8754f80d4e7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:37.464065 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-63db7c05-32da-4271-b859-d8754f80d4e7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:37.464561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-63db7c05-32da-4271-b859-d8754f80d4e7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:37.465345 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-63db7c05-32da-4271-b859-d8754f80d4e7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:37.465773 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-63db7c05-32da-4271-b859-d8754f80d4e7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:37.481914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-63db7c05-32da-4271-b859-d8754f80d4e7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] HTTP exception thrown: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-63db7c05-32da-4271-b859-d8754f80d4e7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Request method failure captured: Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: DELETE /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda HTTP/1.1 Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImbz0WxD1k9ycjcFtONQioapmstd9ALeY-XOY9KWzwZRC4BzRHKOJNKseVz_SOU8X1kqkeZceHCAJurCXmzp5osSOaO2_Ehpi_atwxfvtaZZDfF13_WZ-v9TPM1dlOrXp8wu-OjE4ErE1kdNfUTWsTDESJSRneLOLv_h39cbJpuqhQ Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:58:37.483500 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:58:37.484867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}] Jun 20 14:58:37.484867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:37.484867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:37.484867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:37.484867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:37.484867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:58:37.484867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:58:37.484867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 87c3f39c0bed4fadbc8a556c857baf4a Jun 20 14:58:37.484867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:37.484867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:58:37.484867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. Jun 20 14:58:37.484867 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': 'cbec336a-d2a1-4417-ae64-bf09da7cceda'} Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:58:37.485843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. Jun 20 14:58:37.487081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.488280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-63db7c05-32da-4271-b859-d8754f80d4e7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Returning 404 to user: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:58:37.488280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-63db7c05-32da-4271-b859-d8754f80d4e7 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 404 len: 111 microversion: 2.1 time: 0.033749 Jun 20 14:58:37.488280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 347/706] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:58:37 2022] DELETE /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:58:37.495692 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2b4ba7e4-286b-4bb5-b064-ef7403623ded tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:37.496319 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-2b4ba7e4-286b-4bb5-b064-ef7403623ded tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: cbec336a-d2a1-4417-ae64-bf09da7cceda] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:37.507078 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2b4ba7e4-286b-4bb5-b064-ef7403623ded tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:37.507720 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2b4ba7e4-286b-4bb5-b064-ef7403623ded tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:37.508682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2b4ba7e4-286b-4bb5-b064-ef7403623ded tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:37.509259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2b4ba7e4-286b-4bb5-b064-ef7403623ded tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:37.526127 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-2b4ba7e4-286b-4bb5-b064-ef7403623ded tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] HTTP exception thrown: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2b4ba7e4-286b-4bb5-b064-ef7403623ded tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Request method failure captured: Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda HTTP/1.1 Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImbz0WxD1k9ycjcFtONQioapmstd9ALeY-XOY9KWzwZRC4BzRHKOJNKseVz_SOU8X1kqkeZceHCAJurCXmzp5osSOaO2_Ehpi_atwxfvtaZZDfF13_WZ-v9TPM1dlOrXp8wu-OjE4ErE1kdNfUTWsTDESJSRneLOLv_h39cbJpuqhQ Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:58:37.528162 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:58:37.529581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}] Jun 20 14:58:37.529581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:37.529581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:37.529581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:37.529581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:37.529581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:58:37.529581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:58:37.529581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 87c3f39c0bed4fadbc8a556c857baf4a Jun 20 14:58:37.529581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:37.529581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:58:37.529581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. Jun 20 14:58:37.529581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': 'cbec336a-d2a1-4417-ae64-bf09da7cceda'} Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:58:37.530317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. Jun 20 14:58:37.531510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:37.532631 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2b4ba7e4-286b-4bb5-b064-ef7403623ded tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Returning 404 to user: Instance cbec336a-d2a1-4417-ae64-bf09da7cceda could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:58:37.532631 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-2b4ba7e4-286b-4bb5-b064-ef7403623ded tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda" status: 404 len: 111 microversion: 2.1 time: 0.038206 Jun 20 14:58:37.532631 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 360/707] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:58:37 2022] GET /compute/v2.1/servers/cbec336a-d2a1-4417-ae64-bf09da7cceda => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:58:38.316010 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-96e2c07f-05c1-4ad2-9004-01cb7ba863ac tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:38.316889 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-96e2c07f-05c1-4ad2-9004-01cb7ba863ac tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:38.323988 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-96e2c07f-05c1-4ad2-9004-01cb7ba863ac tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:38.324866 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-96e2c07f-05c1-4ad2-9004-01cb7ba863ac tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:38.325720 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-96e2c07f-05c1-4ad2-9004-01cb7ba863ac tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:38.326221 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-96e2c07f-05c1-4ad2-9004-01cb7ba863ac tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:38.491285 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-96e2c07f-05c1-4ad2-9004-01cb7ba863ac tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:38.502615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-96e2c07f-05c1-4ad2-9004-01cb7ba863ac tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:38.504912 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-96e2c07f-05c1-4ad2-9004-01cb7ba863ac tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:38.506161 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-96e2c07f-05c1-4ad2-9004-01cb7ba863ac tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1738 microversion: 2.20 time: 0.194640 Jun 20 14:58:38.506986 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 348/708] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:38 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:38.736496 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-315c1adb-9fdd-4ac0-84c9-13af91fe124d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:38.737188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-315c1adb-9fdd-4ac0-84c9-13af91fe124d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:38.744372 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-315c1adb-9fdd-4ac0-84c9-13af91fe124d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:38.744846 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-315c1adb-9fdd-4ac0-84c9-13af91fe124d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:38.745638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-315c1adb-9fdd-4ac0-84c9-13af91fe124d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:38.746058 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-315c1adb-9fdd-4ac0-84c9-13af91fe124d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:38.761661 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-315c1adb-9fdd-4ac0-84c9-13af91fe124d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] HTTP exception thrown: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-315c1adb-9fdd-4ac0-84c9-13af91fe124d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Request method failure captured: Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: DELETE /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e HTTP/1.1 Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisImbz0WxD1k9ycjcFtONQioapmstd9ALeY-XOY9KWzwZRC4BzRHKOJNKseVz_SOU8X1kqkeZceHCAJurCXmzp5osSOaO2_Ehpi_atwxfvtaZZDfF13_WZ-v9TPM1dlOrXp8wu-OjE4ErE1kdNfUTWsTDESJSRneLOLv_h39cbJpuqhQ Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:58:38.763388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:58:38.764945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}] Jun 20 14:58:38.764945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:38.764945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:38.764945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:38.764945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:38.764945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:58:38.764945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:58:38.764945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 87c3f39c0bed4fadbc8a556c857baf4a Jun 20 14:58:38.764945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:38.764945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:58:38.764945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. Jun 20 14:58:38.764945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e'} Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:58:38.765804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. Jun 20 14:58:38.767189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:58:38.768465 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-315c1adb-9fdd-4ac0-84c9-13af91fe124d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Returning 404 to user: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:58:38.768465 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-315c1adb-9fdd-4ac0-84c9-13af91fe124d tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 404 len: 111 microversion: 2.1 time: 0.037431 Jun 20 14:58:38.768465 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 361/709] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:58:38 2022] DELETE /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:58:38.775854 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-4673551d-451e-4491-9678-041192aa32c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:38.776467 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-4673551d-451e-4491-9678-041192aa32c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] [instance: 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:38.783171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4673551d-451e-4491-9678-041192aa32c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:38.783807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4673551d-451e-4491-9678-041192aa32c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:38.785034 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4673551d-451e-4491-9678-041192aa32c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:38.785624 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4673551d-451e-4491-9678-041192aa32c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:38.800644 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-4673551d-451e-4491-9678-041192aa32c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] HTTP exception thrown: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-4673551d-451e-4491-9678-041192aa32c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Request method failure captured: Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e HTTP/1.1 Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisImbz0WxD1k9ycjcFtONQioapmstd9ALeY-XOY9KWzwZRC4BzRHKOJNKseVz_SOU8X1kqkeZceHCAJurCXmzp5osSOaO2_Ehpi_atwxfvtaZZDfF13_WZ-v9TPM1dlOrXp8wu-OjE4ErE1kdNfUTWsTDESJSRneLOLv_h39cbJpuqhQ Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:58:38.802314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:58:38.803743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/532cbc0c846c4a528fccd85b0b8ab4d8"}]}] Jun 20 14:58:38.803743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:38.803743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: 532cbc0c846c4a528fccd85b0b8ab4d8 Jun 20 14:58:38.803743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-439904756 Jun 20 14:58:38.803743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:38.803743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:58:38.803743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:58:38.803743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 87c3f39c0bed4fadbc8a556c857baf4a Jun 20 14:58:38.803743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-AttachVolumeNegativeTest-439904756-project Jun 20 14:58:38.803743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:58:38.803743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. Jun 20 14:58:38.803743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': '5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e'} Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:58:38.804608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. Jun 20 14:58:38.806005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:58:38.808155 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-4673551d-451e-4491-9678-041192aa32c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] Returning 404 to user: Instance 5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:58:38.809039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-4673551d-451e-4491-9678-041192aa32c1 tempest-AttachVolumeNegativeTest-439904756 tempest-AttachVolumeNegativeTest-439904756-project] 10.222.0.23 "GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e" status: 404 len: 111 microversion: 2.1 time: 0.037437 Jun 20 14:58:38.809760 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 349/710] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:58:38 2022] GET /compute/v2.1/servers/5bf74bd2-9367-44d2-9f90-1c7aaa0cdc6e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 14:58:39.527059 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-c5c046ac-37dc-467c-898a-594a9397290f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:39.527874 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-c5c046ac-37dc-467c-898a-594a9397290f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:39.534176 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c5c046ac-37dc-467c-898a-594a9397290f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:39.534734 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c5c046ac-37dc-467c-898a-594a9397290f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:39.535498 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c5c046ac-37dc-467c-898a-594a9397290f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:39.536030 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c5c046ac-37dc-467c-898a-594a9397290f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:39.688546 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-c5c046ac-37dc-467c-898a-594a9397290f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:39.698797 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-c5c046ac-37dc-467c-898a-594a9397290f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:39.701031 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-c5c046ac-37dc-467c-898a-594a9397290f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:39.702712 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-c5c046ac-37dc-467c-898a-594a9397290f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1738 microversion: 2.20 time: 0.179591 Jun 20 14:58:39.714552 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 362/711] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:39 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:58:40.727226 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-df1738b8-313c-47ae-98b8-0260df7597ed tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:40.728475 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-df1738b8-313c-47ae-98b8-0260df7597ed tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:40.737638 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-df1738b8-313c-47ae-98b8-0260df7597ed tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:40.738081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-df1738b8-313c-47ae-98b8-0260df7597ed tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:40.738996 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-df1738b8-313c-47ae-98b8-0260df7597ed tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:40.742535 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-df1738b8-313c-47ae-98b8-0260df7597ed tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:40.974032 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-df1738b8-313c-47ae-98b8-0260df7597ed tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:41.002618 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-df1738b8-313c-47ae-98b8-0260df7597ed tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:41.004094 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-df1738b8-313c-47ae-98b8-0260df7597ed tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:41.035576 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-df1738b8-313c-47ae-98b8-0260df7597ed tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1738 microversion: 2.20 time: 0.311522 Jun 20 14:58:41.041337 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 350/712] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:40 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1738 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:42.287312 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3211d3aa-836e-49a2-9a06-684dc16c9cae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:42.288696 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3211d3aa-836e-49a2-9a06-684dc16c9cae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:42.301243 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3211d3aa-836e-49a2-9a06-684dc16c9cae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:42.303369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3211d3aa-836e-49a2-9a06-684dc16c9cae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:42.306671 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3211d3aa-836e-49a2-9a06-684dc16c9cae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:42.307106 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3211d3aa-836e-49a2-9a06-684dc16c9cae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:42.588539 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3211d3aa-836e-49a2-9a06-684dc16c9cae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:42.612214 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3211d3aa-836e-49a2-9a06-684dc16c9cae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:42.614358 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3211d3aa-836e-49a2-9a06-684dc16c9cae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:42.617118 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3211d3aa-836e-49a2-9a06-684dc16c9cae tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1738 microversion: 2.20 time: 0.565757 Jun 20 14:58:42.618163 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 363/713] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:42 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1738 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:43.640165 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ad36ef8e-c027-4e37-a2da-326314ffe9e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:43.640913 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ad36ef8e-c027-4e37-a2da-326314ffe9e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:43.650899 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ad36ef8e-c027-4e37-a2da-326314ffe9e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:43.651341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ad36ef8e-c027-4e37-a2da-326314ffe9e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:43.655758 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ad36ef8e-c027-4e37-a2da-326314ffe9e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:43.657477 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ad36ef8e-c027-4e37-a2da-326314ffe9e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:43.867422 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ad36ef8e-c027-4e37-a2da-326314ffe9e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:43.902674 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ad36ef8e-c027-4e37-a2da-326314ffe9e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:43.906099 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ad36ef8e-c027-4e37-a2da-326314ffe9e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:43.909547 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ad36ef8e-c027-4e37-a2da-326314ffe9e5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1738 microversion: 2.20 time: 0.273642 Jun 20 14:58:43.910152 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 351/714] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:43 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1738 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:44.928618 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8ff11330-09bb-4552-b6d1-e3920be70ec9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:44.929410 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-8ff11330-09bb-4552-b6d1-e3920be70ec9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:44.933282 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:44.938572 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8ff11330-09bb-4552-b6d1-e3920be70ec9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:44.939248 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8ff11330-09bb-4552-b6d1-e3920be70ec9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:44.940279 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8ff11330-09bb-4552-b6d1-e3920be70ec9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:44.940837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8ff11330-09bb-4552-b6d1-e3920be70ec9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:45.107888 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8ff11330-09bb-4552-b6d1-e3920be70ec9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:45.120684 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8ff11330-09bb-4552-b6d1-e3920be70ec9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:45.123049 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8ff11330-09bb-4552-b6d1-e3920be70ec9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:45.124966 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-8ff11330-09bb-4552-b6d1-e3920be70ec9 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1738 microversion: 2.20 time: 0.201424 Jun 20 14:58:45.126607 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 364/715] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:44 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:45.595656 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-926ad205-9bf0-428c-aaa0-b1d57a34b1e5 tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] Calling method '.version_select at 0x7fce508a0820>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:45.643251 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-926ad205-9bf0-428c-aaa0-b1d57a34b1e5 tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/6fef49a5-15dd-4339-bc0f-90c8d6ea859f" status: 200 len: 348 microversion: 2.1 time: 0.051307 Jun 20 14:58:45.643818 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 352/716] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:58:45 2022] GET /compute/v2.1/os-volumes/6fef49a5-15dd-4339-bc0f-90c8d6ea859f => generated 348 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:58:46.146329 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9fb776d9-80e5-48e1-92ad-d7b76afd8472 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:46.147260 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9fb776d9-80e5-48e1-92ad-d7b76afd8472 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:46.154280 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9fb776d9-80e5-48e1-92ad-d7b76afd8472 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:46.154713 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9fb776d9-80e5-48e1-92ad-d7b76afd8472 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:46.155606 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9fb776d9-80e5-48e1-92ad-d7b76afd8472 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:46.156055 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9fb776d9-80e5-48e1-92ad-d7b76afd8472 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:46.309735 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9fb776d9-80e5-48e1-92ad-d7b76afd8472 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:46.317926 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9fb776d9-80e5-48e1-92ad-d7b76afd8472 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:46.319408 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9fb776d9-80e5-48e1-92ad-d7b76afd8472 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:46.320549 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9fb776d9-80e5-48e1-92ad-d7b76afd8472 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1720 microversion: 2.20 time: 0.178783 Jun 20 14:58:46.321133 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 365/717] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:46 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:46.978509 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f13256b2-65d2-4e36-99d8-17a01bd4f75b tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] Calling method '.version_select at 0x7fce509c3d30>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:47.028110 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f13256b2-65d2-4e36-99d8-17a01bd4f75b tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/082f882e-def6-4dcc-ad27-517760b43b47" status: 200 len: 350 microversion: 2.1 time: 0.054140 Jun 20 14:58:47.028677 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 353/718] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:58:46 2022] GET /compute/v2.1/os-volumes/082f882e-def6-4dcc-ad27-517760b43b47 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:58:47.338777 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b4274d57-fa0e-4417-a722-a699a885a168 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:47.339367 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-b4274d57-fa0e-4417-a722-a699a885a168 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:47.345923 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b4274d57-fa0e-4417-a722-a699a885a168 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:47.346367 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b4274d57-fa0e-4417-a722-a699a885a168 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:47.347202 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b4274d57-fa0e-4417-a722-a699a885a168 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:47.347902 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b4274d57-fa0e-4417-a722-a699a885a168 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:47.482642 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-b4274d57-fa0e-4417-a722-a699a885a168 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:47.490852 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-b4274d57-fa0e-4417-a722-a699a885a168 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:47.492427 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-b4274d57-fa0e-4417-a722-a699a885a168 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:47.493610 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-b4274d57-fa0e-4417-a722-a699a885a168 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1720 microversion: 2.20 time: 0.159009 Jun 20 14:58:47.494335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 366/719] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:47 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:58:48.385107 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b9fdeac5-4732-4615-a74b-ba33bae3fdcf tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] Calling method '.version_select at 0x7fce5088e310>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:48.441518 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b9fdeac5-4732-4615-a74b-ba33bae3fdcf tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/df61c16c-87e7-427e-b9f5-d66a7b5418c0" status: 200 len: 350 microversion: 2.1 time: 0.062705 Jun 20 14:58:48.442323 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 354/720] 10.222.0.23 () {58 vars in 1244 bytes} [Mon Jun 20 14:58:48 2022] GET /compute/v2.1/os-volumes/df61c16c-87e7-427e-b9f5-d66a7b5418c0 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:58:48.454509 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-759d955e-ad2e-4c31-8e00-1e68ce1ac340 tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] Calling method '.version_select at 0x7fce509c21f0>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:48.511660 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-57b25418-7d01-4cb3-afb9-afee52dd54db tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:48.512552 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-57b25418-7d01-4cb3-afb9-afee52dd54db tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:48.514891 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:48.526424 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-57b25418-7d01-4cb3-afb9-afee52dd54db tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:48.527178 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-57b25418-7d01-4cb3-afb9-afee52dd54db tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:48.528067 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-57b25418-7d01-4cb3-afb9-afee52dd54db tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:48.528600 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-57b25418-7d01-4cb3-afb9-afee52dd54db tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:48.558051 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-759d955e-ad2e-4c31-8e00-1e68ce1ac340 tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.107425 Jun 20 14:58:48.559294 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 367/721] 10.222.0.23 () {58 vars in 1133 bytes} [Mon Jun 20 14:58:48 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:58:48.574715 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-47ddd8f6-4cfc-4916-a6b8-6c7779fc900d tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] Calling method '.version_select at 0x7fce509b1280>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:48.681210 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-47ddd8f6-4cfc-4916-a6b8-6c7779fc900d tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.112231 Jun 20 14:58:48.689794 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 368/722] 10.222.0.23 () {58 vars in 1148 bytes} [Mon Jun 20 14:58:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:58:48.689794 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-3bb391dc-162d-4651-a1b3-d42a6b1bbffa req-9750f7b2-eb27-438b-82c2-f6866c645d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf05798-c6d2-444f-bed3-1a30d8a8a1bb", "name": "network-vif-unplugged", "status": "completed", "tag": "6a7393ac-776d-4cd4-9e00-be227b057942"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:58:48.696598 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-3bb391dc-162d-4651-a1b3-d42a6b1bbffa req-9750f7b2-eb27-438b-82c2-f6866c645d52 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:48.697082 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-3bb391dc-162d-4651-a1b3-d42a6b1bbffa req-9750f7b2-eb27-438b-82c2-f6866c645d52 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:48.709088 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.compute.server_external_events [req-3bb391dc-162d-4651-a1b3-d42a6b1bbffa req-9750f7b2-eb27-438b-82c2-f6866c645d52 service nova] Unable to find a host for instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb. Dropping event network-vif-unplugged {{(pid=123979) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 20 14:58:48.710000 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-3bb391dc-162d-4651-a1b3-d42a6b1bbffa req-9750f7b2-eb27-438b-82c2-f6866c645d52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026821 Jun 20 14:58:48.710771 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 369/723] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 20 14:58:48.712036 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-57b25418-7d01-4cb3-afb9-afee52dd54db tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:48.715673 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-900c0251-1274-4ac7-83a4-b273531af308 tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] Calling method '.version_select at 0x7fce509c2430>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:48.721262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-57b25418-7d01-4cb3-afb9-afee52dd54db tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:48.723091 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-57b25418-7d01-4cb3-afb9-afee52dd54db tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:48.724347 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-57b25418-7d01-4cb3-afb9-afee52dd54db tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1663 microversion: 2.20 time: 0.216781 Jun 20 14:58:48.724967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 355/724] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:48 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1663 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 14:58:48.742455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b8e3d08e-4e44-4019-986a-25bb849f932f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1077c6bc-d69c-4323-92d2-e2a9a78b8c69"}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:58:48.743885 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-b8e3d08e-4e44-4019-986a-25bb849f932f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:48.750625 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b8e3d08e-4e44-4019-986a-25bb849f932f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:48.751056 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b8e3d08e-4e44-4019-986a-25bb849f932f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:48.752158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b8e3d08e-4e44-4019-986a-25bb849f932f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:48.752543 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b8e3d08e-4e44-4019-986a-25bb849f932f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:48.804526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-900c0251-1274-4ac7-83a4-b273531af308 tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.092293 Jun 20 14:58:48.805142 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 370/725] 10.222.0.23 () {58 vars in 1133 bytes} [Mon Jun 20 14:58:48 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:58:48.817799 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ca847b32-b9ee-45bb-b892-e91cfdcb3430 tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] Calling method '.version_select at 0x7fce509b18b0>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:48.901609 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ca847b32-b9ee-45bb-b892-e91cfdcb3430 tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088651 Jun 20 14:58:48.902429 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 371/726] 10.222.0.23 () {58 vars in 1166 bytes} [Mon Jun 20 14:58:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:58:48.914433 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-699ce72e-0d91-468b-b281-ae1f7b25ebd6 tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] Calling method '.version_select at 0x7fce509e28b0>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:49.006807 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-699ce72e-0d91-468b-b281-ae1f7b25ebd6 tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.096354 Jun 20 14:58:49.007490 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 372/727] 10.222.0.23 () {58 vars in 1169 bytes} [Mon Jun 20 14:58:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:58:49.019542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-fd327e72-baa1-4edc-a14f-56b0c3766dda tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] Calling method '.version_select at 0x7fce509c2670>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:49.070223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b8e3d08e-4e44-4019-986a-25bb849f932f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "POST /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.332189 Jun 20 14:58:49.070838 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 356/728] 10.222.0.23 () {62 vars in 1363 bytes} [Mon Jun 20 14:58:48 2022] POST /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 14:58:49.103550 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-fd327e72-baa1-4edc-a14f-56b0c3766dda tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.087852 Jun 20 14:58:49.104135 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 373/729] 10.222.0.23 () {58 vars in 1154 bytes} [Mon Jun 20 14:58:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:58:49.115641 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-9997c5d9-8d39-41db-9676-efe1a404e748 tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] Calling method '.version_select at 0x7fce508a08b0>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:49.194429 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-cd92508c-027a-4f69-80e6-cdda4dec6ac2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:49.194928 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-cd92508c-027a-4f69-80e6-cdda4dec6ac2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:49.197242 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-9997c5d9-8d39-41db-9676-efe1a404e748 tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085510 Jun 20 14:58:49.198048 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 357/730] 10.222.0.23 () {58 vars in 1187 bytes} [Mon Jun 20 14:58:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:58:49.201364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cd92508c-027a-4f69-80e6-cdda4dec6ac2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:49.201805 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cd92508c-027a-4f69-80e6-cdda4dec6ac2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:49.202633 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cd92508c-027a-4f69-80e6-cdda4dec6ac2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:49.203060 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cd92508c-027a-4f69-80e6-cdda4dec6ac2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:49.211847 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-bab7b748-3f7d-4304-954c-2e9f9d9f8781 tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] Calling method '.version_select at 0x7fce508a03a0>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:49.300288 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-bab7b748-3f7d-4304-954c-2e9f9d9f8781 tempest-VolumesTestJSON-480414127 tempest-VolumesTestJSON-480414127-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.092720 Jun 20 14:58:49.301100 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 358/731] 10.222.0.23 () {58 vars in 1154 bytes} [Mon Jun 20 14:58:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:58:49.441157 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-cd92508c-027a-4f69-80e6-cdda4dec6ac2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb/os-volume_attachments/1077c6bc-d69c-4323-92d2-e2a9a78b8c69" status: 202 len: 0 microversion: 2.20 time: 0.250742 Jun 20 14:58:49.441749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 374/732] 10.222.0.23 () {60 vars in 1456 bytes} [Mon Jun 20 14:58:49 2022] DELETE /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb/os-volume_attachments/1077c6bc-d69c-4323-92d2-e2a9a78b8c69 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:58:49.498088 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3adf5a90-cfb5-4f28-b7e3-bf1077e0ac32 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:58:49.498680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-3adf5a90-cfb5-4f28-b7e3-bf1077e0ac32 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:49.505525 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3adf5a90-cfb5-4f28-b7e3-bf1077e0ac32 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:49.506034 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3adf5a90-cfb5-4f28-b7e3-bf1077e0ac32 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:49.506887 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3adf5a90-cfb5-4f28-b7e3-bf1077e0ac32 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:49.507323 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3adf5a90-cfb5-4f28-b7e3-bf1077e0ac32 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:49.706697 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-3adf5a90-cfb5-4f28-b7e3-bf1077e0ac32 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "POST /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb/action" status: 202 len: 0 microversion: 2.20 time: 0.212948 Jun 20 14:58:49.707475 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 359/733] 10.222.0.23 () {62 vars in 1318 bytes} [Mon Jun 20 14:58:49 2022] POST /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:58:49.716026 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-cea1a4ee-7289-4e0c-8476-1d6a235264f1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:49.716760 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-cea1a4ee-7289-4e0c-8476-1d6a235264f1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:49.723096 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cea1a4ee-7289-4e0c-8476-1d6a235264f1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:49.723537 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cea1a4ee-7289-4e0c-8476-1d6a235264f1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:49.724612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cea1a4ee-7289-4e0c-8476-1d6a235264f1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:49.725063 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cea1a4ee-7289-4e0c-8476-1d6a235264f1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:49.859099 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-cea1a4ee-7289-4e0c-8476-1d6a235264f1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:49.867532 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-cea1a4ee-7289-4e0c-8476-1d6a235264f1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:49.869073 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-cea1a4ee-7289-4e0c-8476-1d6a235264f1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:49.870223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-cea1a4ee-7289-4e0c-8476-1d6a235264f1 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1671 microversion: 2.20 time: 0.158512 Jun 20 14:58:49.870775 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 375/734] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:49 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:50.890192 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0d489f1c-a726-4563-bb18-b5af01a07fee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:50.890948 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-0d489f1c-a726-4563-bb18-b5af01a07fee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:50.898956 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0d489f1c-a726-4563-bb18-b5af01a07fee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:50.899391 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0d489f1c-a726-4563-bb18-b5af01a07fee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:50.900148 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0d489f1c-a726-4563-bb18-b5af01a07fee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:50.900567 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0d489f1c-a726-4563-bb18-b5af01a07fee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:51.041742 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0d489f1c-a726-4563-bb18-b5af01a07fee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:51.049855 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0d489f1c-a726-4563-bb18-b5af01a07fee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:51.051350 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0d489f1c-a726-4563-bb18-b5af01a07fee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:51.052584 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0d489f1c-a726-4563-bb18-b5af01a07fee tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1673 microversion: 2.20 time: 0.167223 Jun 20 14:58:51.053129 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 360/735] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:50 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:52.071483 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d18a1594-61fa-4ade-8ed6-a178486ce710 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:52.072268 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d18a1594-61fa-4ade-8ed6-a178486ce710 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:52.078979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d18a1594-61fa-4ade-8ed6-a178486ce710 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:52.079425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d18a1594-61fa-4ade-8ed6-a178486ce710 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:52.080173 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d18a1594-61fa-4ade-8ed6-a178486ce710 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:52.080602 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d18a1594-61fa-4ade-8ed6-a178486ce710 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:52.220912 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d18a1594-61fa-4ade-8ed6-a178486ce710 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:52.229721 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d18a1594-61fa-4ade-8ed6-a178486ce710 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:52.231355 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d18a1594-61fa-4ade-8ed6-a178486ce710 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:52.232519 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d18a1594-61fa-4ade-8ed6-a178486ce710 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1729 microversion: 2.20 time: 0.165073 Jun 20 14:58:52.233105 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 376/736] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:52 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:53.252257 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-28352a34-56b0-4690-a6c7-a0b6d2abfe1e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:53.253528 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-28352a34-56b0-4690-a6c7-a0b6d2abfe1e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:53.261505 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-28352a34-56b0-4690-a6c7-a0b6d2abfe1e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:53.262389 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-28352a34-56b0-4690-a6c7-a0b6d2abfe1e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:53.263334 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-28352a34-56b0-4690-a6c7-a0b6d2abfe1e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:53.263975 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-28352a34-56b0-4690-a6c7-a0b6d2abfe1e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:53.485430 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-28352a34-56b0-4690-a6c7-a0b6d2abfe1e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:53.494951 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-28352a34-56b0-4690-a6c7-a0b6d2abfe1e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:53.497201 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-28352a34-56b0-4690-a6c7-a0b6d2abfe1e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:53.499460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-28352a34-56b0-4690-a6c7-a0b6d2abfe1e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1729 microversion: 2.20 time: 0.251539 Jun 20 14:58:53.510562 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 361/737] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:53 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1729 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:54.517124 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ad3d75cd-d48d-4e4f-9228-ef4ebfe39603 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:54.517728 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ad3d75cd-d48d-4e4f-9228-ef4ebfe39603 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:54.524793 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ad3d75cd-d48d-4e4f-9228-ef4ebfe39603 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:54.525268 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ad3d75cd-d48d-4e4f-9228-ef4ebfe39603 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:54.526033 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ad3d75cd-d48d-4e4f-9228-ef4ebfe39603 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:54.526452 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ad3d75cd-d48d-4e4f-9228-ef4ebfe39603 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:54.679575 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ad3d75cd-d48d-4e4f-9228-ef4ebfe39603 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:54.688870 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ad3d75cd-d48d-4e4f-9228-ef4ebfe39603 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:54.690563 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ad3d75cd-d48d-4e4f-9228-ef4ebfe39603 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:54.691787 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ad3d75cd-d48d-4e4f-9228-ef4ebfe39603 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1729 microversion: 2.20 time: 0.178866 Jun 20 14:58:54.692409 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 377/738] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:54 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:55.708968 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-57ed4a74-dfd7-4e5a-8403-5882ef91c53b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:55.709628 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-57ed4a74-dfd7-4e5a-8403-5882ef91c53b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:55.716761 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-57ed4a74-dfd7-4e5a-8403-5882ef91c53b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:55.716983 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-57ed4a74-dfd7-4e5a-8403-5882ef91c53b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:55.717929 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-57ed4a74-dfd7-4e5a-8403-5882ef91c53b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:55.718368 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-57ed4a74-dfd7-4e5a-8403-5882ef91c53b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:55.916629 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-57ed4a74-dfd7-4e5a-8403-5882ef91c53b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:55.925917 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-57ed4a74-dfd7-4e5a-8403-5882ef91c53b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:55.927395 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-57ed4a74-dfd7-4e5a-8403-5882ef91c53b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:55.929435 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-57ed4a74-dfd7-4e5a-8403-5882ef91c53b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1729 microversion: 2.20 time: 0.224298 Jun 20 14:58:55.930319 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 362/739] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:55 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:56.950876 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-cc3efada-9b37-4338-b61e-cfc25ba5a687 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:56.951635 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-cc3efada-9b37-4338-b61e-cfc25ba5a687 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:56.958907 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cc3efada-9b37-4338-b61e-cfc25ba5a687 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:56.959510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cc3efada-9b37-4338-b61e-cfc25ba5a687 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:56.960953 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cc3efada-9b37-4338-b61e-cfc25ba5a687 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:56.961459 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cc3efada-9b37-4338-b61e-cfc25ba5a687 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:57.117025 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-cc3efada-9b37-4338-b61e-cfc25ba5a687 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:57.127130 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-cc3efada-9b37-4338-b61e-cfc25ba5a687 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:57.130274 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-cc3efada-9b37-4338-b61e-cfc25ba5a687 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:57.131390 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-cc3efada-9b37-4338-b61e-cfc25ba5a687 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1729 microversion: 2.20 time: 0.185035 Jun 20 14:58:57.141821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 378/740] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:56 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:58.148646 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-19f41a8f-b69f-4e80-9f9d-6ca85c50d127 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:58.149327 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-19f41a8f-b69f-4e80-9f9d-6ca85c50d127 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:58.155756 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-19f41a8f-b69f-4e80-9f9d-6ca85c50d127 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:58.156201 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-19f41a8f-b69f-4e80-9f9d-6ca85c50d127 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:58.156998 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-19f41a8f-b69f-4e80-9f9d-6ca85c50d127 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:58.157460 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-19f41a8f-b69f-4e80-9f9d-6ca85c50d127 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:58.324468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-19f41a8f-b69f-4e80-9f9d-6ca85c50d127 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:58.330055 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:58.337940 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-19f41a8f-b69f-4e80-9f9d-6ca85c50d127 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:58.339432 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-19f41a8f-b69f-4e80-9f9d-6ca85c50d127 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:58.340684 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-19f41a8f-b69f-4e80-9f9d-6ca85c50d127 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1729 microversion: 2.20 time: 0.195934 Jun 20 14:58:58.341288 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 363/741] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:58 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:58:59.361096 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7c6a04f1-9bf8-4946-a7b0-5bd602487116 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:58:59.361729 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7c6a04f1-9bf8-4946-a7b0-5bd602487116 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:58:59.369299 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7c6a04f1-9bf8-4946-a7b0-5bd602487116 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:59.369807 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7c6a04f1-9bf8-4946-a7b0-5bd602487116 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:59.370688 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7c6a04f1-9bf8-4946-a7b0-5bd602487116 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:58:59.371114 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7c6a04f1-9bf8-4946-a7b0-5bd602487116 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:58:59.530164 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7c6a04f1-9bf8-4946-a7b0-5bd602487116 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:59.538768 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7c6a04f1-9bf8-4946-a7b0-5bd602487116 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:59.540245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7c6a04f1-9bf8-4946-a7b0-5bd602487116 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:58:59.541418 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7c6a04f1-9bf8-4946-a7b0-5bd602487116 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1729 microversion: 2.20 time: 0.184302 Jun 20 14:58:59.542003 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 379/742] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:58:59 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:59:00.559924 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-885c743c-7c42-4f1a-8a5f-383636c27940 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:00.561262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-885c743c-7c42-4f1a-8a5f-383636c27940 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:00.568730 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-885c743c-7c42-4f1a-8a5f-383636c27940 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:00.569172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-885c743c-7c42-4f1a-8a5f-383636c27940 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:00.569977 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-885c743c-7c42-4f1a-8a5f-383636c27940 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:00.570399 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-885c743c-7c42-4f1a-8a5f-383636c27940 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:00.710518 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-885c743c-7c42-4f1a-8a5f-383636c27940 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:00.719010 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-885c743c-7c42-4f1a-8a5f-383636c27940 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:00.720508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-885c743c-7c42-4f1a-8a5f-383636c27940 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:00.721698 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-885c743c-7c42-4f1a-8a5f-383636c27940 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1729 microversion: 2.20 time: 0.166020 Jun 20 14:59:00.722232 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 364/743] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:59:00 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:59:01.743852 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0f6ede2a-ff40-482f-acf3-5e82b3c6082a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:01.744547 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-0f6ede2a-ff40-482f-acf3-5e82b3c6082a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:01.752081 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0f6ede2a-ff40-482f-acf3-5e82b3c6082a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:01.752579 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0f6ede2a-ff40-482f-acf3-5e82b3c6082a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:01.753465 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0f6ede2a-ff40-482f-acf3-5e82b3c6082a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:01.753933 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0f6ede2a-ff40-482f-acf3-5e82b3c6082a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:01.894915 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0f6ede2a-ff40-482f-acf3-5e82b3c6082a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:01.906346 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0f6ede2a-ff40-482f-acf3-5e82b3c6082a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:01.907800 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0f6ede2a-ff40-482f-acf3-5e82b3c6082a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:01.908973 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0f6ede2a-ff40-482f-acf3-5e82b3c6082a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1729 microversion: 2.20 time: 0.170685 Jun 20 14:59:01.909533 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 380/744] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:59:01 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:59:02.928394 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-699646d5-fb7f-4873-bac2-ad5d38fa5e89 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:02.929108 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-699646d5-fb7f-4873-bac2-ad5d38fa5e89 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:02.936668 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-699646d5-fb7f-4873-bac2-ad5d38fa5e89 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:02.937158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-699646d5-fb7f-4873-bac2-ad5d38fa5e89 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:02.937918 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-699646d5-fb7f-4873-bac2-ad5d38fa5e89 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:02.938388 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-699646d5-fb7f-4873-bac2-ad5d38fa5e89 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:03.076421 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-699646d5-fb7f-4873-bac2-ad5d38fa5e89 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:03.087405 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-699646d5-fb7f-4873-bac2-ad5d38fa5e89 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:03.088975 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-699646d5-fb7f-4873-bac2-ad5d38fa5e89 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:03.090132 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-699646d5-fb7f-4873-bac2-ad5d38fa5e89 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1729 microversion: 2.20 time: 0.166911 Jun 20 14:59:03.090769 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 365/745] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:59:02 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:59:04.112532 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1cc55c2c-ee9a-47c6-8809-77c4e903f4c2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:04.113499 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-1cc55c2c-ee9a-47c6-8809-77c4e903f4c2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:04.124604 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1cc55c2c-ee9a-47c6-8809-77c4e903f4c2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:04.125400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1cc55c2c-ee9a-47c6-8809-77c4e903f4c2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:04.126697 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1cc55c2c-ee9a-47c6-8809-77c4e903f4c2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:04.127404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1cc55c2c-ee9a-47c6-8809-77c4e903f4c2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:04.144578 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:04.271599 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-1cc55c2c-ee9a-47c6-8809-77c4e903f4c2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:04.281358 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-1cc55c2c-ee9a-47c6-8809-77c4e903f4c2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:04.282807 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-1cc55c2c-ee9a-47c6-8809-77c4e903f4c2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:04.283958 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1cc55c2c-ee9a-47c6-8809-77c4e903f4c2 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1729 microversion: 2.20 time: 0.177925 Jun 20 14:59:04.284509 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 381/746] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:59:04 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:59:05.301870 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-bf931e05-7720-40d4-90d1-7e9e0713ce6b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:05.302640 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-bf931e05-7720-40d4-90d1-7e9e0713ce6b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:05.310660 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bf931e05-7720-40d4-90d1-7e9e0713ce6b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:05.311101 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bf931e05-7720-40d4-90d1-7e9e0713ce6b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:05.311857 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bf931e05-7720-40d4-90d1-7e9e0713ce6b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:05.312284 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-bf931e05-7720-40d4-90d1-7e9e0713ce6b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:05.443935 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-bf931e05-7720-40d4-90d1-7e9e0713ce6b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:05.452287 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-bf931e05-7720-40d4-90d1-7e9e0713ce6b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:05.453788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-bf931e05-7720-40d4-90d1-7e9e0713ce6b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:05.454954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-bf931e05-7720-40d4-90d1-7e9e0713ce6b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1729 microversion: 2.20 time: 0.157117 Jun 20 14:59:05.455514 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 366/747] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:59:05 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:59:06.477560 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-cb4d8507-7053-426e-b0dd-bafc7ec44d2e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:06.478311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-cb4d8507-7053-426e-b0dd-bafc7ec44d2e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:06.486269 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cb4d8507-7053-426e-b0dd-bafc7ec44d2e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:06.486788 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cb4d8507-7053-426e-b0dd-bafc7ec44d2e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:06.487670 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cb4d8507-7053-426e-b0dd-bafc7ec44d2e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:06.488160 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cb4d8507-7053-426e-b0dd-bafc7ec44d2e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:06.625930 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-cb4d8507-7053-426e-b0dd-bafc7ec44d2e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:06.634366 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-cb4d8507-7053-426e-b0dd-bafc7ec44d2e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:06.635870 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-cb4d8507-7053-426e-b0dd-bafc7ec44d2e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:06.637133 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-cb4d8507-7053-426e-b0dd-bafc7ec44d2e tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1729 microversion: 2.20 time: 0.166156 Jun 20 14:59:06.637703 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 382/748] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:59:06 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:59:07.256359 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-9b0c52e9-987f-49b9-b053-b271f2f5d742 req-1dfc8269-8225-431b-b26b-07eb4075d606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf05798-c6d2-444f-bed3-1a30d8a8a1bb", "name": "network-vif-plugged", "status": "completed", "tag": "6a7393ac-776d-4cd4-9e00-be227b057942"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:59:07.267332 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-9b0c52e9-987f-49b9-b053-b271f2f5d742 req-1dfc8269-8225-431b-b26b-07eb4075d606 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:07.267672 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-9b0c52e9-987f-49b9-b053-b271f2f5d742 req-1dfc8269-8225-431b-b26b-07eb4075d606 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:07.280794 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-9b0c52e9-987f-49b9-b053-b271f2f5d742 req-1dfc8269-8225-431b-b26b-07eb4075d606 service nova] Creating event network-vif-plugged:6a7393ac-776d-4cd4-9e00-be227b057942 for instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb on hv-cinder-83697 Jun 20 14:59:07.285831 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-9b0c52e9-987f-49b9-b053-b271f2f5d742 req-1dfc8269-8225-431b-b26b-07eb4075d606 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033432 Jun 20 14:59:07.286429 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 367/749] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:59:07.660230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7bed2a74-b0d7-49a3-b1f1-0241d74b8d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:07.661217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7bed2a74-b0d7-49a3-b1f1-0241d74b8d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:07.672626 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7bed2a74-b0d7-49a3-b1f1-0241d74b8d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:07.673421 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7bed2a74-b0d7-49a3-b1f1-0241d74b8d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:07.674726 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7bed2a74-b0d7-49a3-b1f1-0241d74b8d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:07.675443 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7bed2a74-b0d7-49a3-b1f1-0241d74b8d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:07.822552 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7bed2a74-b0d7-49a3-b1f1-0241d74b8d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:07.832189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7bed2a74-b0d7-49a3-b1f1-0241d74b8d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:07.833707 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7bed2a74-b0d7-49a3-b1f1-0241d74b8d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:07.834867 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7bed2a74-b0d7-49a3-b1f1-0241d74b8d97 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1729 microversion: 2.20 time: 0.181486 Jun 20 14:59:07.835430 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 383/750] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:59:07 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:59:08.859284 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-a297770d-96f1-4ac9-b4ac-ddb01f2ee5fc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:08.860111 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-a297770d-96f1-4ac9-b4ac-ddb01f2ee5fc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:08.866408 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a297770d-96f1-4ac9-b4ac-ddb01f2ee5fc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:08.868097 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a297770d-96f1-4ac9-b4ac-ddb01f2ee5fc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:08.869564 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a297770d-96f1-4ac9-b4ac-ddb01f2ee5fc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:08.870640 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a297770d-96f1-4ac9-b4ac-ddb01f2ee5fc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:09.032983 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-a297770d-96f1-4ac9-b4ac-ddb01f2ee5fc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:09.044121 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-a297770d-96f1-4ac9-b4ac-ddb01f2ee5fc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:09.045703 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-a297770d-96f1-4ac9-b4ac-ddb01f2ee5fc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:09.047163 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-a297770d-96f1-4ac9-b4ac-ddb01f2ee5fc tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1729 microversion: 2.20 time: 0.193061 Jun 20 14:59:09.047807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 368/751] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:59:08 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:59:10.070045 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e59c19f5-155a-4551-8a55-147c85831e6a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:10.070737 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e59c19f5-155a-4551-8a55-147c85831e6a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:10.077529 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e59c19f5-155a-4551-8a55-147c85831e6a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:10.078093 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e59c19f5-155a-4551-8a55-147c85831e6a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:10.079039 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e59c19f5-155a-4551-8a55-147c85831e6a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:10.079462 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e59c19f5-155a-4551-8a55-147c85831e6a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:10.217114 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e59c19f5-155a-4551-8a55-147c85831e6a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:10.225428 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e59c19f5-155a-4551-8a55-147c85831e6a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:10.226905 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e59c19f5-155a-4551-8a55-147c85831e6a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:10.228039 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e59c19f5-155a-4551-8a55-147c85831e6a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1716 microversion: 2.20 time: 0.165794 Jun 20 14:59:10.228597 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 384/752] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:59:10 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1716 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:59:26.152684 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7406f9e1-44b5-491e-bac9-7f5791a8c017 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:26.153237 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7406f9e1-44b5-491e-bac9-7f5791a8c017 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:26.157160 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=25 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:26.157820 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=26 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:26.164121 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7406f9e1-44b5-491e-bac9-7f5791a8c017 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:26.164569 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7406f9e1-44b5-491e-bac9-7f5791a8c017 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:26.165370 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7406f9e1-44b5-491e-bac9-7f5791a8c017 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:26.165802 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7406f9e1-44b5-491e-bac9-7f5791a8c017 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:26.195684 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7406f9e1-44b5-491e-bac9-7f5791a8c017 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 14:59:26.291497 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7406f9e1-44b5-491e-bac9-7f5791a8c017 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 204 len: 0 microversion: 2.1 time: 0.142419 Jun 20 14:59:26.292135 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 369/753] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:59:26 2022] DELETE /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:59:26.300913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e2723820-63ac-4228-b6b5-ae28ad45d38e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:26.301653 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e2723820-63ac-4228-b6b5-ae28ad45d38e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:26.303623 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=29 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:26.304725 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=21 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:26.311741 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e2723820-63ac-4228-b6b5-ae28ad45d38e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:26.312180 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e2723820-63ac-4228-b6b5-ae28ad45d38e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:26.312977 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e2723820-63ac-4228-b6b5-ae28ad45d38e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:26.313416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e2723820-63ac-4228-b6b5-ae28ad45d38e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:26.456571 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e2723820-63ac-4228-b6b5-ae28ad45d38e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:26.464291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e2723820-63ac-4228-b6b5-ae28ad45d38e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1580 microversion: 2.1 time: 0.167714 Jun 20 14:59:26.464889 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 385/754] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:26 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1580 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:59:27.483183 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-cc6656a0-a026-4927-86c6-07403d70197f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:27.484050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-cc6656a0-a026-4927-86c6-07403d70197f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:27.491311 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cc6656a0-a026-4927-86c6-07403d70197f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:27.491761 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cc6656a0-a026-4927-86c6-07403d70197f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:27.492542 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cc6656a0-a026-4927-86c6-07403d70197f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:27.492972 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cc6656a0-a026-4927-86c6-07403d70197f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:27.649569 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-cc6656a0-a026-4927-86c6-07403d70197f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:27.659692 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-cc6656a0-a026-4927-86c6-07403d70197f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1580 microversion: 2.1 time: 0.181530 Jun 20 14:59:27.660278 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 370/755] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:27 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1580 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:28.678874 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-34a64454-f5ba-4a56-a0ba-caa310db7e77 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:28.679498 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-34a64454-f5ba-4a56-a0ba-caa310db7e77 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:28.687879 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-34a64454-f5ba-4a56-a0ba-caa310db7e77 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:28.688607 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-34a64454-f5ba-4a56-a0ba-caa310db7e77 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:28.689502 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-34a64454-f5ba-4a56-a0ba-caa310db7e77 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:28.690036 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-34a64454-f5ba-4a56-a0ba-caa310db7e77 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:28.761295 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-34a64454-f5ba-4a56-a0ba-caa310db7e77 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:28.770016 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-34a64454-f5ba-4a56-a0ba-caa310db7e77 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 200 len: 1512 microversion: 2.1 time: 0.096515 Jun 20 14:59:28.771093 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 386/756] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:28 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 1512 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:28.872557 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-64b5a96f-e2d7-4fc4-94e7-5402a34e08a8 req-6006661e-b4ef-4c36-8e45-ba7d9683f357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3dceca0-38a5-404e-bc35-fd76511a1be5", "name": "network-vif-deleted", "tag": "84467f18-b602-44a1-99d2-d1244386374a"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:59:28.882005 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-64b5a96f-e2d7-4fc4-94e7-5402a34e08a8 req-6006661e-b4ef-4c36-8e45-ba7d9683f357 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:28.882591 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-64b5a96f-e2d7-4fc4-94e7-5402a34e08a8 req-6006661e-b4ef-4c36-8e45-ba7d9683f357 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:28.898477 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-64b5a96f-e2d7-4fc4-94e7-5402a34e08a8 req-6006661e-b4ef-4c36-8e45-ba7d9683f357 service nova] Creating event network-vif-deleted:84467f18-b602-44a1-99d2-d1244386374a for instance b3dceca0-38a5-404e-bc35-fd76511a1be5 on hv-cinder-83697 Jun 20 14:59:28.905482 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-64b5a96f-e2d7-4fc4-94e7-5402a34e08a8 req-6006661e-b4ef-4c36-8e45-ba7d9683f357 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037203 Jun 20 14:59:28.906567 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 371/757] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:59:29.789478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-99ae9fee-4df7-49b3-8fab-80b86aa93cba tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:29.790067 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-99ae9fee-4df7-49b3-8fab-80b86aa93cba tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:29.797912 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-99ae9fee-4df7-49b3-8fab-80b86aa93cba tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:29.798357 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-99ae9fee-4df7-49b3-8fab-80b86aa93cba tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:29.799134 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-99ae9fee-4df7-49b3-8fab-80b86aa93cba tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:29.799727 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-99ae9fee-4df7-49b3-8fab-80b86aa93cba tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:29.815006 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-99ae9fee-4df7-49b3-8fab-80b86aa93cba tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] HTTP exception thrown: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-99ae9fee-4df7-49b3-8fab-80b86aa93cba tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Request method failure captured: Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 HTTP/1.1 Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisIqpXGBp8B1v5MGZCRNAyGekWqImq1Piz28txwlbH_fF3dL1v6RFgdwmZ-ToYeloE4W-TtPwM5aj5AHftuvRtrX8ZtO5dVF9xJvAOdezwBDa1eTBq613LsfvAns5nPoK3H1QLtGc1o6xt74G4kngqwuhX0KaOiRJMJ_Xh6bCB2oqAtw Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: c4515b09c1944036b62a40cc5e88719e Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-TestVolumeBootPattern-787701414 Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:59:29.816542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:59:29.818221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4515b09c1944036b62a40cc5e88719e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4515b09c1944036b62a40cc5e88719e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4515b09c1944036b62a40cc5e88719e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4515b09c1944036b62a40cc5e88719e"}]}] Jun 20 14:59:29.818221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-TestVolumeBootPattern-787701414 Jun 20 14:59:29.818221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: c4515b09c1944036b62a40cc5e88719e Jun 20 14:59:29.818221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-TestVolumeBootPattern-787701414 Jun 20 14:59:29.818221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-TestVolumeBootPattern-787701414-project Jun 20 14:59:29.818221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:59:29.818221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:59:29.818221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 3876008710b8469c9f65a24789a58067 Jun 20 14:59:29.818221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-TestVolumeBootPattern-787701414-project Jun 20 14:59:29.818221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:59:29.818221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. Jun 20 14:59:29.818221 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': 'b3dceca0-38a5-404e-bc35-fd76511a1be5'} Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:59:29.819188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. Jun 20 14:59:29.820778 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:59:29.822125 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-99ae9fee-4df7-49b3-8fab-80b86aa93cba tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Returning 404 to user: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:59:29.822125 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-99ae9fee-4df7-49b3-8fab-80b86aa93cba tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 404 len: 111 microversion: 2.1 time: 0.032640 Jun 20 14:59:29.822125 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 387/758] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:29 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:59:29.929246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1722705848", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2098402945", "security_groups": [{"name": "tempest-secgroup-smoke-1201977844"}], "block_device_mapping_v2": [{"uuid": "5a0ec395-b042-46d3-aec4-bd2e913ed4f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7c7b0d7e-13ae-4804-adde-4f7659f4fca5"}]}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:59:30.053455 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.network.neutron [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] validate_networks() for [('7c7b0d7e-13ae-4804-adde-4f7659f4fca5', None, None, None, None, None)] {{(pid=123978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:59:30.452750 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Flavor limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:59:30.453206 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Image limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:59:30.453670 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Flavor pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:59:30.454073 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Image pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:59:30.454481 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:59:30.464428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:30.464913 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:30.465932 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:30.466376 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:30.483781 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Getting quotas for project c4515b09c1944036b62a40cc5e88719e. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:59:30.488007 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Getting quotas for user 3876008710b8469c9f65a24789a58067 and project c4515b09c1944036b62a40cc5e88719e. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:59:30.547012 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Going to run 1 instances... {{(pid=123978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:59:30.549243 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a0ec395-b042-46d3-aec4-bd2e913ed4f1',volume_size=None,volume_type=None)] {{(pid=123978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:59:30.700110 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-079edb13-ab2b-4d67-87eb-6958c2ed09f9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.775123 Jun 20 14:59:30.701491 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 372/759] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 14:59:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 14:59:30.711350 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-f9f1d426-740f-4181-b3e5-99c5d458eec9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:30.712055 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-f9f1d426-740f-4181-b3e5-99c5d458eec9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:30.763322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1650674887", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452"}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:59:30.786436 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-f9f1d426-740f-4181-b3e5-99c5d458eec9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:30.797018 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-f9f1d426-740f-4181-b3e5-99c5d458eec9 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1095 microversion: 2.1 time: 0.089475 Jun 20 14:59:30.797620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 388/760] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:30 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1095 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:30.824395 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.network.neutron [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] validate_networks() for None {{(pid=123978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 14:59:31.396507 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Flavor limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 14:59:31.397170 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Image limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 14:59:31.397417 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Flavor pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 14:59:31.397821 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Image pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 14:59:31.398261 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 14:59:31.408100 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:31.408544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:31.409375 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:31.409808 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:31.427421 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Getting quotas for project 7c552a1581a24af68d15de18b9b110b0. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 14:59:31.431628 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Getting quotas for user bda1b22c1bf9413ca9cbf4d49ca0ba17 and project 7c552a1581a24af68d15de18b9b110b0. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 14:59:31.444584 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Going to run 1 instances... {{(pid=123978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 14:59:31.446767 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 14:59:31.494130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6736a436-17de-4437-9cc6-2064dfb67ed7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.734671 Jun 20 14:59:31.494803 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 373/761] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 14:59:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 14:59:31.505696 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3a89acde-012e-4067-bd26-ee7578c4748c tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:31.506291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3a89acde-012e-4067-bd26-ee7578c4748c tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:31.562816 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-3a89acde-012e-4067-bd26-ee7578c4748c tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1b22c1bf9413ca9cbf4d49ca0ba17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c552a1581a24af68d15de18b9b110b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:31.572032 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3a89acde-012e-4067-bd26-ee7578c4748c tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3" status: 200 len: 1215 microversion: 2.1 time: 0.070421 Jun 20 14:59:31.572687 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 389/762] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:31 2022] GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:31.815853 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c3cf0083-85fc-42c3-9da8-01fe5345991e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:31.816886 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-c3cf0083-85fc-42c3-9da8-01fe5345991e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:31.826186 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c3cf0083-85fc-42c3-9da8-01fe5345991e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:31.826807 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c3cf0083-85fc-42c3-9da8-01fe5345991e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:31.828312 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c3cf0083-85fc-42c3-9da8-01fe5345991e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:31.829084 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c3cf0083-85fc-42c3-9da8-01fe5345991e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:31.933195 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-c3cf0083-85fc-42c3-9da8-01fe5345991e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:31.942531 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-c3cf0083-85fc-42c3-9da8-01fe5345991e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1211 microversion: 2.1 time: 0.131117 Jun 20 14:59:31.943603 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 374/763] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:31 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1211 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:32.590077 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-51daf150-c39b-4ae9-93f3-64291fa6b6cd tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:32.591039 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-51daf150-c39b-4ae9-93f3-64291fa6b6cd tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:32.613022 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-51daf150-c39b-4ae9-93f3-64291fa6b6cd tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:32.613467 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-51daf150-c39b-4ae9-93f3-64291fa6b6cd tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:32.614276 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-51daf150-c39b-4ae9-93f3-64291fa6b6cd tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:32.614824 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-51daf150-c39b-4ae9-93f3-64291fa6b6cd tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:32.755870 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-51daf150-c39b-4ae9-93f3-64291fa6b6cd tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1b22c1bf9413ca9cbf4d49ca0ba17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c552a1581a24af68d15de18b9b110b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:32.765772 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-51daf150-c39b-4ae9-93f3-64291fa6b6cd tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3" status: 200 len: 1285 microversion: 2.1 time: 0.180190 Jun 20 14:59:32.766545 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 390/764] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:32 2022] GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 => generated 1285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:32.961144 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b52019d9-4e9c-4feb-9099-9f71ac2ecc37 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:32.962375 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-b52019d9-4e9c-4feb-9099-9f71ac2ecc37 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:32.970714 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b52019d9-4e9c-4feb-9099-9f71ac2ecc37 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:32.971505 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b52019d9-4e9c-4feb-9099-9f71ac2ecc37 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:32.972444 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b52019d9-4e9c-4feb-9099-9f71ac2ecc37 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:32.973184 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b52019d9-4e9c-4feb-9099-9f71ac2ecc37 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:33.226985 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-dedeb5ad-e76e-4baf-90b0-7130996dd77d req-c63847d7-5431-4454-8823-7e77740cb4db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d491eee1-9ae6-4a88-b3d1-cda530e8f1e0", "tag": "e68a946e-bfca-40bd-9849-6e3aa603cf23"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:59:33.234587 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-b52019d9-4e9c-4feb-9099-9f71ac2ecc37 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:33.245024 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-dedeb5ad-e76e-4baf-90b0-7130996dd77d req-c63847d7-5431-4454-8823-7e77740cb4db service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:33.246214 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-dedeb5ad-e76e-4baf-90b0-7130996dd77d req-c63847d7-5431-4454-8823-7e77740cb4db service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:33.246322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b52019d9-4e9c-4feb-9099-9f71ac2ecc37 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1267 microversion: 2.1 time: 0.289154 Jun 20 14:59:33.249066 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 375/765] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:32 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1267 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:33.268393 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-dedeb5ad-e76e-4baf-90b0-7130996dd77d req-c63847d7-5431-4454-8823-7e77740cb4db service nova] Creating event network-changed:e68a946e-bfca-40bd-9849-6e3aa603cf23 for instance d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 on hv-cinder-83697 Jun 20 14:59:33.274709 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-dedeb5ad-e76e-4baf-90b0-7130996dd77d req-c63847d7-5431-4454-8823-7e77740cb4db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052681 Jun 20 14:59:33.275716 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 391/766] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:59:33.783110 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f1cd4ff7-41a6-4e1d-a656-b0e7680ef8be tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:33.783737 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f1cd4ff7-41a6-4e1d-a656-b0e7680ef8be tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:33.789902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1cd4ff7-41a6-4e1d-a656-b0e7680ef8be tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:33.790340 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1cd4ff7-41a6-4e1d-a656-b0e7680ef8be tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:33.791124 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1cd4ff7-41a6-4e1d-a656-b0e7680ef8be tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:33.791543 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f1cd4ff7-41a6-4e1d-a656-b0e7680ef8be tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:33.968208 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f1cd4ff7-41a6-4e1d-a656-b0e7680ef8be tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1b22c1bf9413ca9cbf4d49ca0ba17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c552a1581a24af68d15de18b9b110b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:33.978582 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f1cd4ff7-41a6-4e1d-a656-b0e7680ef8be tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3" status: 200 len: 1315 microversion: 2.1 time: 0.199007 Jun 20 14:59:33.979735 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 376/767] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:33 2022] GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:34.266692 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-a6c76841-afb3-4b72-bb0f-795173457c99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:34.268002 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-a6c76841-afb3-4b72-bb0f-795173457c99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:34.274628 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a6c76841-afb3-4b72-bb0f-795173457c99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:34.275302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a6c76841-afb3-4b72-bb0f-795173457c99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:34.276057 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a6c76841-afb3-4b72-bb0f-795173457c99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:34.276647 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a6c76841-afb3-4b72-bb0f-795173457c99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:34.499795 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a6c76841-afb3-4b72-bb0f-795173457c99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:34.507519 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-a6c76841-afb3-4b72-bb0f-795173457c99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1267 microversion: 2.1 time: 0.245786 Jun 20 14:59:34.508213 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 392/768] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:34 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:34.755636 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-1936b8a4-2151-46ca-8960-23723f1dc340 req-5406e492-13b6-44f6-9411-b8d25ec3af5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c58917e-0f4e-44c9-a198-1271e4545ed3", "tag": "88443ab5-378f-4cb6-a208-83a7efb77767"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:59:34.764836 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-1936b8a4-2151-46ca-8960-23723f1dc340 req-5406e492-13b6-44f6-9411-b8d25ec3af5e service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:34.765502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-1936b8a4-2151-46ca-8960-23723f1dc340 req-5406e492-13b6-44f6-9411-b8d25ec3af5e service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:34.778258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-1936b8a4-2151-46ca-8960-23723f1dc340 req-5406e492-13b6-44f6-9411-b8d25ec3af5e service nova] Creating event network-changed:88443ab5-378f-4cb6-a208-83a7efb77767 for instance 1c58917e-0f4e-44c9-a198-1271e4545ed3 on hv-cinder-83697 Jun 20 14:59:34.783713 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-1936b8a4-2151-46ca-8960-23723f1dc340 req-5406e492-13b6-44f6-9411-b8d25ec3af5e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181797 Jun 20 14:59:34.785020 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 377/769] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:59:34.995674 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-68dda271-cc20-40c6-bd24-b67c6550acc7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:34.996374 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-68dda271-cc20-40c6-bd24-b67c6550acc7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:35.003254 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-68dda271-cc20-40c6-bd24-b67c6550acc7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:35.003685 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-68dda271-cc20-40c6-bd24-b67c6550acc7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:35.004557 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-68dda271-cc20-40c6-bd24-b67c6550acc7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:35.005071 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-68dda271-cc20-40c6-bd24-b67c6550acc7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:35.151351 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-68dda271-cc20-40c6-bd24-b67c6550acc7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1b22c1bf9413ca9cbf4d49ca0ba17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c552a1581a24af68d15de18b9b110b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:35.159635 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-68dda271-cc20-40c6-bd24-b67c6550acc7 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3" status: 200 len: 1315 microversion: 2.1 time: 0.167928 Jun 20 14:59:35.160210 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 393/770] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:34 2022] GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:35.526419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ae6deace-14fe-49c3-9d4f-e20d280e6a4f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:35.527127 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ae6deace-14fe-49c3-9d4f-e20d280e6a4f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:35.534007 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ae6deace-14fe-49c3-9d4f-e20d280e6a4f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:35.534450 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ae6deace-14fe-49c3-9d4f-e20d280e6a4f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:35.535211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ae6deace-14fe-49c3-9d4f-e20d280e6a4f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:35.535636 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ae6deace-14fe-49c3-9d4f-e20d280e6a4f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:35.673443 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ae6deace-14fe-49c3-9d4f-e20d280e6a4f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:35.681951 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ae6deace-14fe-49c3-9d4f-e20d280e6a4f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1267 microversion: 2.1 time: 0.160265 Jun 20 14:59:35.682523 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 378/771] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:35 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:36.176961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-a3cd6f87-f51a-4e8b-b23f-246fa49a6891 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:36.177521 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-a3cd6f87-f51a-4e8b-b23f-246fa49a6891 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:36.185674 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a3cd6f87-f51a-4e8b-b23f-246fa49a6891 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:36.186187 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a3cd6f87-f51a-4e8b-b23f-246fa49a6891 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:36.187054 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a3cd6f87-f51a-4e8b-b23f-246fa49a6891 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:36.187493 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a3cd6f87-f51a-4e8b-b23f-246fa49a6891 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:36.396044 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a3cd6f87-f51a-4e8b-b23f-246fa49a6891 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1b22c1bf9413ca9cbf4d49ca0ba17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c552a1581a24af68d15de18b9b110b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:36.404510 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-a3cd6f87-f51a-4e8b-b23f-246fa49a6891 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3" status: 200 len: 1315 microversion: 2.1 time: 0.231759 Jun 20 14:59:36.405146 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 394/772] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:36 2022] GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:36.703591 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-82e3e8dd-1b38-4534-82c6-ac13d137cb99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:36.704207 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-82e3e8dd-1b38-4534-82c6-ac13d137cb99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:36.711296 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-82e3e8dd-1b38-4534-82c6-ac13d137cb99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:36.711733 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-82e3e8dd-1b38-4534-82c6-ac13d137cb99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:36.712520 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-82e3e8dd-1b38-4534-82c6-ac13d137cb99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:36.712981 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-82e3e8dd-1b38-4534-82c6-ac13d137cb99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:36.853138 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-82e3e8dd-1b38-4534-82c6-ac13d137cb99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:36.864788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-82e3e8dd-1b38-4534-82c6-ac13d137cb99 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1267 microversion: 2.1 time: 0.165252 Jun 20 14:59:36.865653 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 379/773] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:36 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:37.423886 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7a4e279b-6e4c-404d-a7dd-36b4c9bcceae tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:37.424494 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7a4e279b-6e4c-404d-a7dd-36b4c9bcceae tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:37.431245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7a4e279b-6e4c-404d-a7dd-36b4c9bcceae tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:37.431691 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7a4e279b-6e4c-404d-a7dd-36b4c9bcceae tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:37.432469 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7a4e279b-6e4c-404d-a7dd-36b4c9bcceae tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:37.432924 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7a4e279b-6e4c-404d-a7dd-36b4c9bcceae tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:37.567331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7a4e279b-6e4c-404d-a7dd-36b4c9bcceae tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1b22c1bf9413ca9cbf4d49ca0ba17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c552a1581a24af68d15de18b9b110b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:37.575228 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7a4e279b-6e4c-404d-a7dd-36b4c9bcceae tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3" status: 200 len: 1315 microversion: 2.1 time: 0.155298 Jun 20 14:59:37.575794 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 395/774] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:37 2022] GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:37.884839 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f0c887fe-2a3e-4720-81dd-67e1d973afc8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:37.885448 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f0c887fe-2a3e-4720-81dd-67e1d973afc8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:37.892561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f0c887fe-2a3e-4720-81dd-67e1d973afc8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:37.893099 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f0c887fe-2a3e-4720-81dd-67e1d973afc8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:37.893981 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f0c887fe-2a3e-4720-81dd-67e1d973afc8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:37.894402 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f0c887fe-2a3e-4720-81dd-67e1d973afc8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:38.032834 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f0c887fe-2a3e-4720-81dd-67e1d973afc8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:38.040644 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f0c887fe-2a3e-4720-81dd-67e1d973afc8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1267 microversion: 2.1 time: 0.159725 Jun 20 14:59:38.041241 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 380/775] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:37 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:38.598554 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-96dcd74c-3ac5-4a5e-b8e4-352d0bf67d47 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:38.599165 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-96dcd74c-3ac5-4a5e-b8e4-352d0bf67d47 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:38.605992 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-96dcd74c-3ac5-4a5e-b8e4-352d0bf67d47 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:38.606475 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-96dcd74c-3ac5-4a5e-b8e4-352d0bf67d47 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:38.607236 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-96dcd74c-3ac5-4a5e-b8e4-352d0bf67d47 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:38.607669 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-96dcd74c-3ac5-4a5e-b8e4-352d0bf67d47 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:38.754600 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-96dcd74c-3ac5-4a5e-b8e4-352d0bf67d47 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1b22c1bf9413ca9cbf4d49ca0ba17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c552a1581a24af68d15de18b9b110b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:38.763687 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-96dcd74c-3ac5-4a5e-b8e4-352d0bf67d47 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3" status: 200 len: 1315 microversion: 2.1 time: 0.169060 Jun 20 14:59:38.764268 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 396/776] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:38 2022] GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:39.057988 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-af50333a-6938-4340-beb0-43da0f4c91fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:39.058631 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-af50333a-6938-4340-beb0-43da0f4c91fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:39.066284 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-af50333a-6938-4340-beb0-43da0f4c91fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:39.066728 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-af50333a-6938-4340-beb0-43da0f4c91fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:39.067494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-af50333a-6938-4340-beb0-43da0f4c91fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:39.067927 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-af50333a-6938-4340-beb0-43da0f4c91fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:39.208479 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-af50333a-6938-4340-beb0-43da0f4c91fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:39.219078 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-af50333a-6938-4340-beb0-43da0f4c91fa tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1267 microversion: 2.1 time: 0.164812 Jun 20 14:59:39.219992 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 381/777] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:39 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:39.469467 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-d6670dac-674f-44ff-94dd-076b86f925c1 req-86db1ae6-f7f1-47e6-804f-de2aaf534745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c58917e-0f4e-44c9-a198-1271e4545ed3", "name": "network-vif-plugged", "status": "completed", "tag": "88443ab5-378f-4cb6-a208-83a7efb77767"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:59:39.477508 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-d6670dac-674f-44ff-94dd-076b86f925c1 req-86db1ae6-f7f1-47e6-804f-de2aaf534745 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:39.477939 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-d6670dac-674f-44ff-94dd-076b86f925c1 req-86db1ae6-f7f1-47e6-804f-de2aaf534745 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:39.490407 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-d6670dac-674f-44ff-94dd-076b86f925c1 req-86db1ae6-f7f1-47e6-804f-de2aaf534745 service nova] Creating event network-vif-plugged:88443ab5-378f-4cb6-a208-83a7efb77767 for instance 1c58917e-0f4e-44c9-a198-1271e4545ed3 on hv-cinder-83697 Jun 20 14:59:39.495189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-d6670dac-674f-44ff-94dd-076b86f925c1 req-86db1ae6-f7f1-47e6-804f-de2aaf534745 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029811 Jun 20 14:59:39.495786 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 397/778] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:59:39.782963 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-daee0c30-c318-40c4-85f1-33274d7cfc49 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:39.783573 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-daee0c30-c318-40c4-85f1-33274d7cfc49 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:39.791071 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-daee0c30-c318-40c4-85f1-33274d7cfc49 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:39.791517 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-daee0c30-c318-40c4-85f1-33274d7cfc49 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:39.792314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-daee0c30-c318-40c4-85f1-33274d7cfc49 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:39.792757 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-daee0c30-c318-40c4-85f1-33274d7cfc49 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:39.926094 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-daee0c30-c318-40c4-85f1-33274d7cfc49 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1b22c1bf9413ca9cbf4d49ca0ba17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c552a1581a24af68d15de18b9b110b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:39.933950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-daee0c30-c318-40c4-85f1-33274d7cfc49 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3" status: 200 len: 1315 microversion: 2.1 time: 0.155033 Jun 20 14:59:39.934522 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 382/779] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:39 2022] GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:40.237675 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-fadb643b-3537-48fd-b2a2-35aee765e341 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:40.238335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-fadb643b-3537-48fd-b2a2-35aee765e341 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:40.245150 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fadb643b-3537-48fd-b2a2-35aee765e341 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:40.245585 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fadb643b-3537-48fd-b2a2-35aee765e341 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:40.246349 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fadb643b-3537-48fd-b2a2-35aee765e341 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:40.246781 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-fadb643b-3537-48fd-b2a2-35aee765e341 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:40.387744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-fadb643b-3537-48fd-b2a2-35aee765e341 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:40.395862 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-fadb643b-3537-48fd-b2a2-35aee765e341 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1267 microversion: 2.1 time: 0.163026 Jun 20 14:59:40.396434 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 398/780] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:40 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:40.955480 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f76dc163-a660-41ed-8862-797acbd4318f tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:40.956062 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f76dc163-a660-41ed-8862-797acbd4318f tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:40.963403 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f76dc163-a660-41ed-8862-797acbd4318f tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:40.963844 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f76dc163-a660-41ed-8862-797acbd4318f tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:40.964608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f76dc163-a660-41ed-8862-797acbd4318f tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:40.965068 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f76dc163-a660-41ed-8862-797acbd4318f tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:41.104314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f76dc163-a660-41ed-8862-797acbd4318f tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1b22c1bf9413ca9cbf4d49ca0ba17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c552a1581a24af68d15de18b9b110b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:41.112560 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f76dc163-a660-41ed-8862-797acbd4318f tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3" status: 200 len: 1465 microversion: 2.1 time: 0.161090 Jun 20 14:59:41.113179 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 383/781] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:40 2022] GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 => generated 1465 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:41.157584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-eaf8c110-0b8d-40bf-9f7d-f6dad86e12e2 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:41.158167 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-eaf8c110-0b8d-40bf-9f7d-f6dad86e12e2 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:41.164960 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-eaf8c110-0b8d-40bf-9f7d-f6dad86e12e2 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:41.165493 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-eaf8c110-0b8d-40bf-9f7d-f6dad86e12e2 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:41.166334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-eaf8c110-0b8d-40bf-9f7d-f6dad86e12e2 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:41.166833 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-eaf8c110-0b8d-40bf-9f7d-f6dad86e12e2 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:41.193303 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-eaf8c110-0b8d-40bf-9f7d-f6dad86e12e2 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Going to try to terminate instance {{(pid=123979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 14:59:41.278490 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-eaf8c110-0b8d-40bf-9f7d-f6dad86e12e2 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3" status: 204 len: 0 microversion: 2.1 time: 0.124957 Jun 20 14:59:41.279179 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 399/782] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 14:59:41 2022] DELETE /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 14:59:41.287943 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e89f9d65-d0f4-43f9-9330-34732aaeeeed tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:41.288546 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e89f9d65-d0f4-43f9-9330-34732aaeeeed tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:41.294996 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e89f9d65-d0f4-43f9-9330-34732aaeeeed tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:41.295438 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e89f9d65-d0f4-43f9-9330-34732aaeeeed tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:41.296196 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e89f9d65-d0f4-43f9-9330-34732aaeeeed tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:41.296632 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e89f9d65-d0f4-43f9-9330-34732aaeeeed tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:41.413607 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-cef03d56-f38f-40e9-8b50-3485daabc018 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:41.414804 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-cef03d56-f38f-40e9-8b50-3485daabc018 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:41.417660 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=4 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:41.423438 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cef03d56-f38f-40e9-8b50-3485daabc018 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:41.424165 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cef03d56-f38f-40e9-8b50-3485daabc018 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:41.425327 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cef03d56-f38f-40e9-8b50-3485daabc018 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:41.425948 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cef03d56-f38f-40e9-8b50-3485daabc018 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:41.440600 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-e89f9d65-d0f4-43f9-9330-34732aaeeeed tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1b22c1bf9413ca9cbf4d49ca0ba17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c552a1581a24af68d15de18b9b110b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:41.444469 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=12 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:41.450621 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e89f9d65-d0f4-43f9-9330-34732aaeeeed tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3" status: 200 len: 1471 microversion: 2.1 time: 0.166841 Jun 20 14:59:41.451392 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 384/783] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:41 2022] GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:41.567023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-cef03d56-f38f-40e9-8b50-3485daabc018 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:41.569524 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=4 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:41.576241 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-cef03d56-f38f-40e9-8b50-3485daabc018 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1267 microversion: 2.1 time: 0.167373 Jun 20 14:59:41.576834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 400/784] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:41 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:59:42.468308 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b2319aed-d19c-4f11-9bf2-db9a1d184179 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:42.468891 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-b2319aed-d19c-4f11-9bf2-db9a1d184179 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:42.476271 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b2319aed-d19c-4f11-9bf2-db9a1d184179 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:42.476704 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b2319aed-d19c-4f11-9bf2-db9a1d184179 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:42.477485 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b2319aed-d19c-4f11-9bf2-db9a1d184179 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:42.477940 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b2319aed-d19c-4f11-9bf2-db9a1d184179 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:42.593339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9d1e290a-6444-4cf6-a872-b617b1d5f727 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:42.593949 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9d1e290a-6444-4cf6-a872-b617b1d5f727 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:42.600948 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9d1e290a-6444-4cf6-a872-b617b1d5f727 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:42.601404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9d1e290a-6444-4cf6-a872-b617b1d5f727 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:42.602179 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9d1e290a-6444-4cf6-a872-b617b1d5f727 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:42.602614 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9d1e290a-6444-4cf6-a872-b617b1d5f727 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:42.620047 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-b2319aed-d19c-4f11-9bf2-db9a1d184179 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1b22c1bf9413ca9cbf4d49ca0ba17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c552a1581a24af68d15de18b9b110b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:42.628108 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b2319aed-d19c-4f11-9bf2-db9a1d184179 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3" status: 200 len: 1471 microversion: 2.1 time: 0.163803 Jun 20 14:59:42.628699 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 385/785] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:42 2022] GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:42.801815 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9d1e290a-6444-4cf6-a872-b617b1d5f727 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:42.810055 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9d1e290a-6444-4cf6-a872-b617b1d5f727 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1267 microversion: 2.1 time: 0.220342 Jun 20 14:59:42.814432 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 401/786] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:42 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:59:43.208896 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-7dc431af-c234-49d9-a507-3eb961487bcb req-9ae55550-28bf-45f6-ab5e-d1fefdbe1b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c58917e-0f4e-44c9-a198-1271e4545ed3", "name": "network-vif-deleted", "tag": "88443ab5-378f-4cb6-a208-83a7efb77767"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:59:43.217692 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-7dc431af-c234-49d9-a507-3eb961487bcb req-9ae55550-28bf-45f6-ab5e-d1fefdbe1b2d service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:43.218134 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-7dc431af-c234-49d9-a507-3eb961487bcb req-9ae55550-28bf-45f6-ab5e-d1fefdbe1b2d service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:43.238939 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-7dc431af-c234-49d9-a507-3eb961487bcb req-9ae55550-28bf-45f6-ab5e-d1fefdbe1b2d service nova] Creating event network-vif-deleted:88443ab5-378f-4cb6-a208-83a7efb77767 for instance 1c58917e-0f4e-44c9-a198-1271e4545ed3 on hv-cinder-83697 Jun 20 14:59:43.249459 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-7dc431af-c234-49d9-a507-3eb961487bcb req-9ae55550-28bf-45f6-ab5e-d1fefdbe1b2d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044141 Jun 20 14:59:43.251039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 386/787] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:59:43.294333 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d51aa5b5-75bc-4b42-bd99-56c101f27ec4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:43.296271 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d51aa5b5-75bc-4b42-bd99-56c101f27ec4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:43.312840 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d51aa5b5-75bc-4b42-bd99-56c101f27ec4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:43.313560 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d51aa5b5-75bc-4b42-bd99-56c101f27ec4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:43.315141 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d51aa5b5-75bc-4b42-bd99-56c101f27ec4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:43.315583 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d51aa5b5-75bc-4b42-bd99-56c101f27ec4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:43.354529 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d51aa5b5-75bc-4b42-bd99-56c101f27ec4 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.065550 Jun 20 14:59:43.355122 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 402/788] 10.222.0.23 () {60 vars in 1342 bytes} [Mon Jun 20 14:59:43 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:43.420490 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6410c7b0-0a16-4aa6-a8a0-1eefc519b042 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:43.421115 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6410c7b0-0a16-4aa6-a8a0-1eefc519b042 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:43.427565 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6410c7b0-0a16-4aa6-a8a0-1eefc519b042 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:43.427981 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6410c7b0-0a16-4aa6-a8a0-1eefc519b042 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:43.428804 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6410c7b0-0a16-4aa6-a8a0-1eefc519b042 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:43.429211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6410c7b0-0a16-4aa6-a8a0-1eefc519b042 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:43.433950 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:43.458710 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6410c7b0-0a16-4aa6-a8a0-1eefc519b042 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 14:59:43.505923 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-a6f8732a-75bf-4b9e-bff1-86ab510b8112 req-866f8d40-2f69-4f88-8926-3ae696fe4aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d491eee1-9ae6-4a88-b3d1-cda530e8f1e0", "name": "network-vif-plugged", "status": "completed", "tag": "e68a946e-bfca-40bd-9849-6e3aa603cf23"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:59:43.514588 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-a6f8732a-75bf-4b9e-bff1-86ab510b8112 req-866f8d40-2f69-4f88-8926-3ae696fe4aaa service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:43.514954 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-a6f8732a-75bf-4b9e-bff1-86ab510b8112 req-866f8d40-2f69-4f88-8926-3ae696fe4aaa service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:43.529328 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-a6f8732a-75bf-4b9e-bff1-86ab510b8112 req-866f8d40-2f69-4f88-8926-3ae696fe4aaa service nova] Creating event network-vif-plugged:e68a946e-bfca-40bd-9849-6e3aa603cf23 for instance d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 on hv-cinder-83697 Jun 20 14:59:43.534831 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-a6f8732a-75bf-4b9e-bff1-86ab510b8112 req-866f8d40-2f69-4f88-8926-3ae696fe4aaa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033128 Jun 20 14:59:43.535646 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 403/789] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:59:43.547325 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6410c7b0-0a16-4aa6-a8a0-1eefc519b042 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 204 len: 0 microversion: 2.20 time: 0.130415 Jun 20 14:59:43.551951 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 387/790] 10.222.0.23 () {60 vars in 1279 bytes} [Mon Jun 20 14:59:43 2022] DELETE /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 20 14:59:43.557747 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-5499bbce-a61c-4674-a71b-f07b60cf139f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:43.558435 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-5499bbce-a61c-4674-a71b-f07b60cf139f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:43.565460 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5499bbce-a61c-4674-a71b-f07b60cf139f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:43.565901 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5499bbce-a61c-4674-a71b-f07b60cf139f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:43.566652 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5499bbce-a61c-4674-a71b-f07b60cf139f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:43.567074 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5499bbce-a61c-4674-a71b-f07b60cf139f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:43.586957 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:43.648513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-070541d6-4687-4dd1-a31a-1d3cb7b6f727 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:43.649091 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-070541d6-4687-4dd1-a31a-1d3cb7b6f727 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:43.658319 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-070541d6-4687-4dd1-a31a-1d3cb7b6f727 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:43.658996 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-070541d6-4687-4dd1-a31a-1d3cb7b6f727 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:43.660030 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-070541d6-4687-4dd1-a31a-1d3cb7b6f727 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:43.660466 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-070541d6-4687-4dd1-a31a-1d3cb7b6f727 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:43.696629 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-070541d6-4687-4dd1-a31a-1d3cb7b6f727 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:43.697100 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-070541d6-4687-4dd1-a31a-1d3cb7b6f727 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:43.697544 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-070541d6-4687-4dd1-a31a-1d3cb7b6f727 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lazy-loading 'fault' on Instance uuid 1c58917e-0f4e-44c9-a198-1271e4545ed3 {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:59:43.717788 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-5499bbce-a61c-4674-a71b-f07b60cf139f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:43.726783 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-5499bbce-a61c-4674-a71b-f07b60cf139f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:43.728651 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-5499bbce-a61c-4674-a71b-f07b60cf139f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:43.729864 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-5499bbce-a61c-4674-a71b-f07b60cf139f tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.176420 Jun 20 14:59:43.730436 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 404/791] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:59:43 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:59:43.741694 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-070541d6-4687-4dd1-a31a-1d3cb7b6f727 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1b22c1bf9413ca9cbf4d49ca0ba17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c552a1581a24af68d15de18b9b110b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:43.749471 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-070541d6-4687-4dd1-a31a-1d3cb7b6f727 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3" status: 200 len: 1305 microversion: 2.1 time: 0.106048 Jun 20 14:59:43.750055 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 388/792] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:43 2022] GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:59:43.832500 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6e07ccd4-dd57-4b89-add7-a49e3fa56d6d tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:43.833029 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-6e07ccd4-dd57-4b89-add7-a49e3fa56d6d tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:43.840127 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6e07ccd4-dd57-4b89-add7-a49e3fa56d6d tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:43.840620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6e07ccd4-dd57-4b89-add7-a49e3fa56d6d tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:43.841576 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6e07ccd4-dd57-4b89-add7-a49e3fa56d6d tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:43.842055 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6e07ccd4-dd57-4b89-add7-a49e3fa56d6d tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:43.980499 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6e07ccd4-dd57-4b89-add7-a49e3fa56d6d tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:43.988829 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6e07ccd4-dd57-4b89-add7-a49e3fa56d6d tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1267 microversion: 2.1 time: 0.160195 Jun 20 14:59:43.989622 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 405/793] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:43 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:44.748729 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0f4527de-5e27-4746-aca4-82e5d626116a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:44.750285 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-0f4527de-5e27-4746-aca4-82e5d626116a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:44.757882 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0f4527de-5e27-4746-aca4-82e5d626116a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:44.758612 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0f4527de-5e27-4746-aca4-82e5d626116a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:44.761522 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0f4527de-5e27-4746-aca4-82e5d626116a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:44.762052 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0f4527de-5e27-4746-aca4-82e5d626116a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:44.767798 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-918f90c1-7177-45a9-842b-2c0bbc216776 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:44.768557 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-918f90c1-7177-45a9-842b-2c0bbc216776 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:44.780293 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-918f90c1-7177-45a9-842b-2c0bbc216776 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:44.783649 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-918f90c1-7177-45a9-842b-2c0bbc216776 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:44.784591 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-918f90c1-7177-45a9-842b-2c0bbc216776 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:44.785149 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-918f90c1-7177-45a9-842b-2c0bbc216776 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:44.843755 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-918f90c1-7177-45a9-842b-2c0bbc216776 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:44.844297 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-918f90c1-7177-45a9-842b-2c0bbc216776 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:44.845404 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.objects.instance [None req-918f90c1-7177-45a9-842b-2c0bbc216776 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lazy-loading 'fault' on Instance uuid 1c58917e-0f4e-44c9-a198-1271e4545ed3 {{(pid=123979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 14:59:44.904136 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-918f90c1-7177-45a9-842b-2c0bbc216776 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1b22c1bf9413ca9cbf4d49ca0ba17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c552a1581a24af68d15de18b9b110b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:44.914617 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-918f90c1-7177-45a9-842b-2c0bbc216776 tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3" status: 200 len: 1305 microversion: 2.1 time: 0.151960 Jun 20 14:59:44.915812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 406/794] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:44 2022] GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 => generated 1305 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 14:59:44.926884 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0f4527de-5e27-4746-aca4-82e5d626116a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:44.941008 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0f4527de-5e27-4746-aca4-82e5d626116a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:44.942895 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0f4527de-5e27-4746-aca4-82e5d626116a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:44.944092 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0f4527de-5e27-4746-aca4-82e5d626116a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1722 microversion: 2.20 time: 0.200418 Jun 20 14:59:44.944691 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 389/795] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:59:44 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:59:45.007029 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7295d708-afc7-4bb2-9f5c-351bdecd4b72 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:45.007029 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7295d708-afc7-4bb2-9f5c-351bdecd4b72 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:45.015726 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7295d708-afc7-4bb2-9f5c-351bdecd4b72 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:45.016449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7295d708-afc7-4bb2-9f5c-351bdecd4b72 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:45.017512 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7295d708-afc7-4bb2-9f5c-351bdecd4b72 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:45.018212 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7295d708-afc7-4bb2-9f5c-351bdecd4b72 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:45.163791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7295d708-afc7-4bb2-9f5c-351bdecd4b72 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:45.171637 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7295d708-afc7-4bb2-9f5c-351bdecd4b72 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1267 microversion: 2.1 time: 0.169725 Jun 20 14:59:45.172166 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 407/796] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:45 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:45.931826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-124ef791-b841-4f8d-b7ee-8ba1af721f7a tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:45.932406 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-124ef791-b841-4f8d-b7ee-8ba1af721f7a tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] [instance: 1c58917e-0f4e-44c9-a198-1271e4545ed3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:45.939888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-124ef791-b841-4f8d-b7ee-8ba1af721f7a tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:45.940356 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-124ef791-b841-4f8d-b7ee-8ba1af721f7a tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:45.941159 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-124ef791-b841-4f8d-b7ee-8ba1af721f7a tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:45.941586 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-124ef791-b841-4f8d-b7ee-8ba1af721f7a tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:45.959773 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-124ef791-b841-4f8d-b7ee-8ba1af721f7a tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] HTTP exception thrown: Instance 1c58917e-0f4e-44c9-a198-1271e4545ed3 could not be found. Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-124ef791-b841-4f8d-b7ee-8ba1af721f7a tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Request method failure captured: Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 HTTP/1.1 Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisItRl-MgPAnqQvqL9VXtSAKfV29zAgQBb2r43jJw5dvTERSn8fEVJhdHQwbXALhqsmyvpDHwGrRS8POPCOjBK3aDWQDrZSTIA8UU1-yvP79HLPyy2S4LHXCX38_YQrV-6zrUEYn-7ektwZetxbBsnObt95KMjRxn0Nz_0FaTFPfgu0k Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: 7c552a1581a24af68d15de18b9b110b0 Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-VolumesNegativeTest-1847950141 Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:59:45.961801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:59:45.963620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7c552a1581a24af68d15de18b9b110b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7c552a1581a24af68d15de18b9b110b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c552a1581a24af68d15de18b9b110b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7c552a1581a24af68d15de18b9b110b0"}]}] Jun 20 14:59:45.963620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-VolumesNegativeTest-1847950141 Jun 20 14:59:45.963620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: 7c552a1581a24af68d15de18b9b110b0 Jun 20 14:59:45.963620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-VolumesNegativeTest-1847950141 Jun 20 14:59:45.963620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-VolumesNegativeTest-1847950141-project Jun 20 14:59:45.963620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:59:45.963620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:59:45.963620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: bda1b22c1bf9413ca9cbf4d49ca0ba17 Jun 20 14:59:45.963620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-VolumesNegativeTest-1847950141-project Jun 20 14:59:45.963620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:59:45.963620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance 1c58917e-0f4e-44c9-a198-1271e4545ed3 could not be found. Jun 20 14:59:45.963620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': '1c58917e-0f4e-44c9-a198-1271e4545ed3'} Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c58917e-0f4e-44c9-a198-1271e4545ed3 could not be found. Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:59:45.964645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c58917e-0f4e-44c9-a198-1271e4545ed3 could not be found. Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c58917e-0f4e-44c9-a198-1271e4545ed3 could not be found. Jun 20 14:59:45.970447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:45.972705 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-124ef791-b841-4f8d-b7ee-8ba1af721f7a tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] Returning 404 to user: Instance 1c58917e-0f4e-44c9-a198-1271e4545ed3 could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:59:45.972705 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-124ef791-b841-4f8d-b7ee-8ba1af721f7a tempest-VolumesNegativeTest-1847950141 tempest-VolumesNegativeTest-1847950141-project] 10.222.0.23 "GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3" status: 404 len: 111 microversion: 2.1 time: 0.035511 Jun 20 14:59:45.972919 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-888b5760-50f3-4e65-80e0-6dac0a0441ec tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:45.972919 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-888b5760-50f3-4e65-80e0-6dac0a0441ec tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:45.973366 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 390/797] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:45 2022] GET /compute/v2.1/servers/1c58917e-0f4e-44c9-a198-1271e4545ed3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 14:59:45.984531 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-888b5760-50f3-4e65-80e0-6dac0a0441ec tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:45.985016 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-888b5760-50f3-4e65-80e0-6dac0a0441ec tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:45.985782 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-888b5760-50f3-4e65-80e0-6dac0a0441ec tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:45.986206 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-888b5760-50f3-4e65-80e0-6dac0a0441ec tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:46.070592 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-d955ca43-ef55-414f-ba84-5fb2ba826706 req-c6e5439f-fc6a-4ad9-a36a-faefa2f74bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf05798-c6d2-444f-bed3-1a30d8a8a1bb", "name": "network-vif-deleted", "tag": "6a7393ac-776d-4cd4-9e00-be227b057942"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:59:46.080597 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-d955ca43-ef55-414f-ba84-5fb2ba826706 req-c6e5439f-fc6a-4ad9-a36a-faefa2f74bc1 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:46.081447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-d955ca43-ef55-414f-ba84-5fb2ba826706 req-c6e5439f-fc6a-4ad9-a36a-faefa2f74bc1 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:46.095174 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-d955ca43-ef55-414f-ba84-5fb2ba826706 req-c6e5439f-fc6a-4ad9-a36a-faefa2f74bc1 service nova] Creating event network-vif-deleted:6a7393ac-776d-4cd4-9e00-be227b057942 for instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb on hv-cinder-83697 Jun 20 14:59:46.095877 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-888b5760-50f3-4e65-80e0-6dac0a0441ec tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:46.102201 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-d955ca43-ef55-414f-ba84-5fb2ba826706 req-c6e5439f-fc6a-4ad9-a36a-faefa2f74bc1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035888 Jun 20 14:59:46.104466 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-888b5760-50f3-4e65-80e0-6dac0a0441ec tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:46.106081 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-888b5760-50f3-4e65-80e0-6dac0a0441ec tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69c4f81285904da78e96a4a515ec2cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f7478c9384ee298321a1506aa0bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:46.107230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-888b5760-50f3-4e65-80e0-6dac0a0441ec tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 200 len: 1655 microversion: 2.20 time: 0.147632 Jun 20 14:59:46.107718 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 391/798] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 14:59:46.113182 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 408/799] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:59:45 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 1655 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 14:59:46.190910 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6e711c86-00a2-45b4-8eb8-924e3f128063 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:46.191630 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6e711c86-00a2-45b4-8eb8-924e3f128063 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:46.201451 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6e711c86-00a2-45b4-8eb8-924e3f128063 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:46.201907 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6e711c86-00a2-45b4-8eb8-924e3f128063 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:46.202924 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6e711c86-00a2-45b4-8eb8-924e3f128063 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:46.203557 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6e711c86-00a2-45b4-8eb8-924e3f128063 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:46.377714 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-6e711c86-00a2-45b4-8eb8-924e3f128063 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:46.386363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6e711c86-00a2-45b4-8eb8-924e3f128063 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1454 microversion: 2.1 time: 0.201666 Jun 20 14:59:46.387745 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 392/800] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:46 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1454 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:46.403947 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b47b30a3-cabf-42ee-9446-d3d88f652431 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:46.404839 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-b47b30a3-cabf-42ee-9446-d3d88f652431 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:46.411608 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b47b30a3-cabf-42ee-9446-d3d88f652431 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:46.412652 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b47b30a3-cabf-42ee-9446-d3d88f652431 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:46.414498 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b47b30a3-cabf-42ee-9446-d3d88f652431 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:46.415777 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b47b30a3-cabf-42ee-9446-d3d88f652431 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:46.580247 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-b47b30a3-cabf-42ee-9446-d3d88f652431 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 14:59:46.595150 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-b47b30a3-cabf-42ee-9446-d3d88f652431 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1454 microversion: 2.1 time: 0.195517 Jun 20 14:59:46.604967 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 409/801] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 14:59:46 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1454 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 14:59:47.127224 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-aae94138-1f4b-4bf0-ad1b-0f519f173cc5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:47.128604 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-aae94138-1f4b-4bf0-ad1b-0f519f173cc5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:47.136465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-aae94138-1f4b-4bf0-ad1b-0f519f173cc5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:47.137261 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-aae94138-1f4b-4bf0-ad1b-0f519f173cc5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:47.138047 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-aae94138-1f4b-4bf0-ad1b-0f519f173cc5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:47.138477 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-aae94138-1f4b-4bf0-ad1b-0f519f173cc5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:47.155140 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-aae94138-1f4b-4bf0-ad1b-0f519f173cc5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] HTTP exception thrown: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-aae94138-1f4b-4bf0-ad1b-0f519f173cc5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Request method failure captured: Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb HTTP/1.1 Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisIn1omX1LdPmoP7_iLX9vyogN9njqksXXS4meXl1V0zIzeu1OtU2r7vRNyp89nH7TTTJOuB10m14UZQw4a17YxwE2ATTaGDqOemFVz54o5yguZzhysIuoRL9T8bm4oSqwCCrkMq5_cPvPVWdqIjrDUaHPRD8z803038RSDklaAO17Rw Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: a98f7478c9384ee298321a1506aa0bde Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:59:47.157039 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:59:47.158468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a98f7478c9384ee298321a1506aa0bde"}]}] Jun 20 14:59:47.158468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:59:47.158468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: a98f7478c9384ee298321a1506aa0bde Jun 20 14:59:47.158468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:59:47.158468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-AttachVolumeShelveTestJSON-2055176739-project Jun 20 14:59:47.158468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:59:47.158468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:59:47.158468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 69c4f81285904da78e96a4a515ec2cb2 Jun 20 14:59:47.158468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2055176739-project Jun 20 14:59:47.158468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:59:47.158468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. Jun 20 14:59:47.158468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': 'aaf05798-c6d2-444f-bed3-1a30d8a8a1bb'} Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:59:47.159246 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. Jun 20 14:59:47.160428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:47.161538 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-aae94138-1f4b-4bf0-ad1b-0f519f173cc5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Returning 404 to user: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:59:47.161538 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-aae94138-1f4b-4bf0-ad1b-0f519f173cc5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 404 len: 111 microversion: 2.20 time: 0.035522 Jun 20 14:59:47.162471 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 393/802] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:59:47 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 14:59:47.167375 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-69409e3e-3847-462d-b3c3-df6c41f21037 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '.version_select at 0x7fce50973ee0>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:47.188351 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-69409e3e-3847-462d-b3c3-df6c41f21037 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429421949" status: 204 len: 0 microversion: 2.20 time: 0.024647 Jun 20 14:59:47.192827 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 410/803] 10.222.0.23 () {60 vars in 1261 bytes} [Mon Jun 20 14:59:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429421949 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 14:59:48.789434 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-cbd7c05c-7c05-466f-b764-55e7cff394e3 req-29f814bc-5c57-450d-a731-e22b5a559c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d491eee1-9ae6-4a88-b3d1-cda530e8f1e0", "tag": "e68a946e-bfca-40bd-9849-6e3aa603cf23"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 14:59:48.799994 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-cbd7c05c-7c05-466f-b764-55e7cff394e3 req-29f814bc-5c57-450d-a731-e22b5a559c22 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:48.800505 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-cbd7c05c-7c05-466f-b764-55e7cff394e3 req-29f814bc-5c57-450d-a731-e22b5a559c22 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:48.815668 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-cbd7c05c-7c05-466f-b764-55e7cff394e3 req-29f814bc-5c57-450d-a731-e22b5a559c22 service nova] Creating event network-changed:e68a946e-bfca-40bd-9849-6e3aa603cf23 for instance d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 on hv-cinder-83697 Jun 20 14:59:48.823136 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-cbd7c05c-7c05-466f-b764-55e7cff394e3 req-29f814bc-5c57-450d-a731-e22b5a559c22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037299 Jun 20 14:59:48.824148 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 394/804] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 14:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 14:59:49.177751 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9b8eea27-d43e-4372-9632-751f67b6057b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:49.178244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9b8eea27-d43e-4372-9632-751f67b6057b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:49.186248 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9b8eea27-d43e-4372-9632-751f67b6057b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:49.186761 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9b8eea27-d43e-4372-9632-751f67b6057b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:49.187897 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9b8eea27-d43e-4372-9632-751f67b6057b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:49.188563 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9b8eea27-d43e-4372-9632-751f67b6057b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:49.202735 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-9b8eea27-d43e-4372-9632-751f67b6057b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] HTTP exception thrown: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9b8eea27-d43e-4372-9632-751f67b6057b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Request method failure captured: Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: DELETE /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb HTTP/1.1 Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisIn1omX1LdPmoP7_iLX9vyogN9njqksXXS4meXl1V0zIzeu1OtU2r7vRNyp89nH7TTTJOuB10m14UZQw4a17YxwE2ATTaGDqOemFVz54o5yguZzhysIuoRL9T8bm4oSqwCCrkMq5_cPvPVWdqIjrDUaHPRD8z803038RSDklaAO17Rw Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: a98f7478c9384ee298321a1506aa0bde Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:59:49.204682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:59:49.206678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a98f7478c9384ee298321a1506aa0bde"}]}] Jun 20 14:59:49.206678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:59:49.206678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: a98f7478c9384ee298321a1506aa0bde Jun 20 14:59:49.206678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:59:49.206678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-AttachVolumeShelveTestJSON-2055176739-project Jun 20 14:59:49.206678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:59:49.206678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:59:49.206678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 69c4f81285904da78e96a4a515ec2cb2 Jun 20 14:59:49.206678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2055176739-project Jun 20 14:59:49.206678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:59:49.206678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. Jun 20 14:59:49.206678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': 'aaf05798-c6d2-444f-bed3-1a30d8a8a1bb'} Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:59:49.207624 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. Jun 20 14:59:49.209119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:59:49.211625 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9b8eea27-d43e-4372-9632-751f67b6057b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Returning 404 to user: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:59:49.212840 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9b8eea27-d43e-4372-9632-751f67b6057b tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 404 len: 111 microversion: 2.20 time: 0.039717 Jun 20 14:59:49.213772 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 411/805] 10.222.0.23 () {60 vars in 1279 bytes} [Mon Jun 20 14:59:49 2022] DELETE /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 14:59:49.223433 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d3693f91-0b26-44a2-9d2c-f2c7d1870eb5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:49.224435 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-d3693f91-0b26-44a2-9d2c-f2c7d1870eb5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: aaf05798-c6d2-444f-bed3-1a30d8a8a1bb] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:49.231371 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d3693f91-0b26-44a2-9d2c-f2c7d1870eb5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:49.231921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d3693f91-0b26-44a2-9d2c-f2c7d1870eb5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:49.232606 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d3693f91-0b26-44a2-9d2c-f2c7d1870eb5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:49.233064 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d3693f91-0b26-44a2-9d2c-f2c7d1870eb5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:49.247123 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-d3693f91-0b26-44a2-9d2c-f2c7d1870eb5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] HTTP exception thrown: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d3693f91-0b26-44a2-9d2c-f2c7d1870eb5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Request method failure captured: Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb HTTP/1.1 Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisIn1omX1LdPmoP7_iLX9vyogN9njqksXXS4meXl1V0zIzeu1OtU2r7vRNyp89nH7TTTJOuB10m14UZQw4a17YxwE2ATTaGDqOemFVz54o5yguZzhysIuoRL9T8bm4oSqwCCrkMq5_cPvPVWdqIjrDUaHPRD8z803038RSDklaAO17Rw Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: a98f7478c9384ee298321a1506aa0bde Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:59:49.249326 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:59:49.251322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a98f7478c9384ee298321a1506aa0bde"}]}] Jun 20 14:59:49.251322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:59:49.251322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: a98f7478c9384ee298321a1506aa0bde Jun 20 14:59:49.251322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:59:49.251322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-AttachVolumeShelveTestJSON-2055176739-project Jun 20 14:59:49.251322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:59:49.251322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:59:49.251322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 69c4f81285904da78e96a4a515ec2cb2 Jun 20 14:59:49.251322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2055176739-project Jun 20 14:59:49.251322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:59:49.251322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. Jun 20 14:59:49.251322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': 'aaf05798-c6d2-444f-bed3-1a30d8a8a1bb'} Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:59:49.252313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. Jun 20 14:59:49.253680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:49.255651 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d3693f91-0b26-44a2-9d2c-f2c7d1870eb5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Returning 404 to user: Instance aaf05798-c6d2-444f-bed3-1a30d8a8a1bb could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:59:49.256665 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d3693f91-0b26-44a2-9d2c-f2c7d1870eb5 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb" status: 404 len: 111 microversion: 2.20 time: 0.038116 Jun 20 14:59:49.257259 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 395/806] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:59:49 2022] GET /compute/v2.1/servers/aaf05798-c6d2-444f-bed3-1a30d8a8a1bb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 14:59:50.426830 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3f508a90-e26b-45a2-8c74-f932a5ba7db3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:50.427449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3f508a90-e26b-45a2-8c74-f932a5ba7db3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:50.435272 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3f508a90-e26b-45a2-8c74-f932a5ba7db3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:50.435781 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3f508a90-e26b-45a2-8c74-f932a5ba7db3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:50.436627 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3f508a90-e26b-45a2-8c74-f932a5ba7db3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:50.437143 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3f508a90-e26b-45a2-8c74-f932a5ba7db3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:50.451597 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-3f508a90-e26b-45a2-8c74-f932a5ba7db3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] HTTP exception thrown: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3f508a90-e26b-45a2-8c74-f932a5ba7db3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Request method failure captured: Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: DELETE /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b HTTP/1.1 Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisIn1omX1LdPmoP7_iLX9vyogN9njqksXXS4meXl1V0zIzeu1OtU2r7vRNyp89nH7TTTJOuB10m14UZQw4a17YxwE2ATTaGDqOemFVz54o5yguZzhysIuoRL9T8bm4oSqwCCrkMq5_cPvPVWdqIjrDUaHPRD8z803038RSDklaAO17Rw Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: a98f7478c9384ee298321a1506aa0bde Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 14:59:50.453334 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 14:59:50.454752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a98f7478c9384ee298321a1506aa0bde"}]}] Jun 20 14:59:50.454752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:59:50.454752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: a98f7478c9384ee298321a1506aa0bde Jun 20 14:59:50.454752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:59:50.454752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-AttachVolumeShelveTestJSON-2055176739-project Jun 20 14:59:50.454752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 14:59:50.454752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 14:59:50.454752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 69c4f81285904da78e96a4a515ec2cb2 Jun 20 14:59:50.454752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2055176739-project Jun 20 14:59:50.454752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 14:59:50.454752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. Jun 20 14:59:50.454752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '916159e1-4580-4bb4-a78f-857e9e15c61b'} Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:59:50.455489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. Jun 20 14:59:50.456744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 14:59:50.458798 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3f508a90-e26b-45a2-8c74-f932a5ba7db3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Returning 404 to user: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:59:50.459791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3f508a90-e26b-45a2-8c74-f932a5ba7db3 tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "DELETE /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 404 len: 111 microversion: 2.20 time: 0.036909 Jun 20 14:59:50.460344 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 412/807] 10.222.0.23 () {60 vars in 1279 bytes} [Mon Jun 20 14:59:50 2022] DELETE /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 14:59:50.468613 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7263d4d5-58e1-4044-9a3e-d1935d0ce22a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 14:59:50.469255 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7263d4d5-58e1-4044-9a3e-d1935d0ce22a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] [instance: 916159e1-4580-4bb4-a78f-857e9e15c61b] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 14:59:50.472686 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:50.478718 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7263d4d5-58e1-4044-9a3e-d1935d0ce22a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:50.479159 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7263d4d5-58e1-4044-9a3e-d1935d0ce22a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:50.479930 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7263d4d5-58e1-4044-9a3e-d1935d0ce22a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 14:59:50.480348 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7263d4d5-58e1-4044-9a3e-d1935d0ce22a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 14:59:50.496099 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-7263d4d5-58e1-4044-9a3e-d1935d0ce22a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] HTTP exception thrown: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7263d4d5-58e1-4044-9a3e-d1935d0ce22a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Request method failure captured: Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b HTTP/1.1 Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisIn1omX1LdPmoP7_iLX9vyogN9njqksXXS4meXl1V0zIzeu1OtU2r7vRNyp89nH7TTTJOuB10m14UZQw4a17YxwE2ATTaGDqOemFVz54o5yguZzhysIuoRL9T8bm4oSqwCCrkMq5_cPvPVWdqIjrDUaHPRD8z803038RSDklaAO17Rw Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: a98f7478c9384ee298321a1506aa0bde Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 14:59:50.497727 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 14:59:50.499379 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a98f7478c9384ee298321a1506aa0bde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a98f7478c9384ee298321a1506aa0bde"}]}] Jun 20 14:59:50.499379 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:59:50.499379 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: a98f7478c9384ee298321a1506aa0bde Jun 20 14:59:50.499379 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2055176739 Jun 20 14:59:50.499379 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-AttachVolumeShelveTestJSON-2055176739-project Jun 20 14:59:50.499379 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 14:59:50.499379 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 14:59:50.499379 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 69c4f81285904da78e96a4a515ec2cb2 Jun 20 14:59:50.499379 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2055176739-project Jun 20 14:59:50.499379 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 14:59:50.499379 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. Jun 20 14:59:50.499379 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': '916159e1-4580-4bb4-a78f-857e9e15c61b'} Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 14:59:50.500465 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. Jun 20 14:59:50.501967 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 14:59:50.503820 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7263d4d5-58e1-4044-9a3e-d1935d0ce22a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] Returning 404 to user: Instance 916159e1-4580-4bb4-a78f-857e9e15c61b could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 14:59:50.503820 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7263d4d5-58e1-4044-9a3e-d1935d0ce22a tempest-AttachVolumeShelveTestJSON-2055176739 tempest-AttachVolumeShelveTestJSON-2055176739-project] 10.222.0.23 "GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b" status: 404 len: 111 microversion: 2.20 time: 0.034525 Jun 20 14:59:50.503820 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 396/808] 10.222.0.23 () {60 vars in 1276 bytes} [Mon Jun 20 14:59:50 2022] GET /compute/v2.1/servers/916159e1-4580-4bb4-a78f-857e9e15c61b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 15:00:01.569506 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:01.570670 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=38 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:01.864060 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-c97097a6-4bf5-461f-89e1-88eac5513c96 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Action: 'create', calling method: .version_select at 0x7fce50a94ee0>, body: {"keypair": {"name": "tempest-keypair-927469104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGmJ79pxr/rrJpq8USV6dnnCXx87HJRdMbew7436ONvKqSI+hk3Q/XgLdPoZ76JWMLPWwnjLujdMAQrz1kOuK8X/p4g0QMXlXv6yscY/FZxCFj1jfMFMxSYVm6USQA5fQ=="}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:00:01.918015 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-c97097a6-4bf5-461f-89e1-88eac5513c96 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Getting quotas for project d70851020f444aeeaa7a5cb23615719f. Resources: {'key_pairs'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 15:00:01.938126 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-c97097a6-4bf5-461f-89e1-88eac5513c96 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Getting quotas for user 5a547b71ff3848ea97f77c9664a7068e and project d70851020f444aeeaa7a5cb23615719f. Resources: {'key_pairs'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 15:00:01.992637 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-c97097a6-4bf5-461f-89e1-88eac5513c96 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.430337 Jun 20 15:00:01.994633 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 413/809] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 15:00:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 15:00:03.731866 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:03.915946 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-13fc57b5-4ae4-413e-a054-a65d4da1ea80 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Action: 'create', calling method: .version_select at 0x7fce5082b0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1858792678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgdOkomncpSuso+vBFTjNHmRl29P30xNm5wxR6l/+FduTMm821kgxkIe/OytKr9P62Z7jHk/zoi/aM0qNytlrWVu2kWHLvAUNh+xPYScZVFlOa4E5/hKjWqctXE1fPzyQ=="}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:00:03.953831 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-13fc57b5-4ae4-413e-a054-a65d4da1ea80 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Getting quotas for project f29cab4870474548b98c3a81a3aa8031. Resources: {'key_pairs'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 15:00:03.958225 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-13fc57b5-4ae4-413e-a054-a65d4da1ea80 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Getting quotas for user 5422c53c285f4e33998f7aabe528750c and project f29cab4870474548b98c3a81a3aa8031. Resources: {'key_pairs'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 15:00:03.987951 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-13fc57b5-4ae4-413e-a054-a65d4da1ea80 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.262697 Jun 20 15:00:03.989078 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 397/810] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 15:00:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:00:04.132561 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1307369113", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdd7e8d5-15a5-4084-b9ed-420beae9e4cd"}], "security_groups": [{"name": "tempest-securitygroup--575289202"}], "key_name": "tempest-keypair-927469104", "user_data": "}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:00:04.280528 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.network.neutron [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] validate_networks() for [('bdd7e8d5-15a5-4084-b9ed-420beae9e4cd', None, None, None, None, None)] {{(pid=123979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 15:00:05.242332 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Flavor limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 15:00:05.242984 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Image limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 15:00:05.247563 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Flavor pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 15:00:05.248776 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Image pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 15:00:05.250437 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 15:00:05.265318 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:05.265890 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:05.266766 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:05.267273 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:05.285523 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Getting quotas for project d70851020f444aeeaa7a5cb23615719f. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 15:00:05.290160 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Getting quotas for user 5a547b71ff3848ea97f77c9664a7068e and project d70851020f444aeeaa7a5cb23615719f. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 15:00:05.302723 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Going to run 1 instances... {{(pid=123979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 15:00:05.305236 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 15:00:05.359385 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-8d788d44-66f5-4044-9dd3-b17c9eba60e0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.232065 Jun 20 15:00:05.360151 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 414/811] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 15:00:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 15:00:05.371527 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-4efee657-5db0-4cfc-9e2a-eadcd1ad1367 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:05.372117 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-4efee657-5db0-4cfc-9e2a-eadcd1ad1367 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:05.452081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-4efee657-5db0-4cfc-9e2a-eadcd1ad1367 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:05.460681 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-4efee657-5db0-4cfc-9e2a-eadcd1ad1367 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1237 microversion: 2.1 time: 0.093632 Jun 20 15:00:05.461537 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 398/812] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:05 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:06.478009 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-dab98d72-f9c3-46b6-9b5f-2beec598f72c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:06.479818 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-dab98d72-f9c3-46b6-9b5f-2beec598f72c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:06.490519 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dab98d72-f9c3-46b6-9b5f-2beec598f72c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:06.491861 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dab98d72-f9c3-46b6-9b5f-2beec598f72c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:06.493432 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dab98d72-f9c3-46b6-9b5f-2beec598f72c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:06.494113 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dab98d72-f9c3-46b6-9b5f-2beec598f72c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:06.592270 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-dab98d72-f9c3-46b6-9b5f-2beec598f72c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:06.601796 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-dab98d72-f9c3-46b6-9b5f-2beec598f72c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1297 microversion: 2.1 time: 0.127953 Jun 20 15:00:06.612253 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 415/813] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:06 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1297 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:07.627218 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-42fefb33-1081-44ad-b67e-16e87c993b24 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:07.629016 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-42fefb33-1081-44ad-b67e-16e87c993b24 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:07.638711 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-42fefb33-1081-44ad-b67e-16e87c993b24 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:07.639384 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-42fefb33-1081-44ad-b67e-16e87c993b24 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:07.640351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-42fefb33-1081-44ad-b67e-16e87c993b24 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:07.641010 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-42fefb33-1081-44ad-b67e-16e87c993b24 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:07.964162 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-42fefb33-1081-44ad-b67e-16e87c993b24 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:07.978288 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-42fefb33-1081-44ad-b67e-16e87c993b24 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1362 microversion: 2.1 time: 0.361829 Jun 20 15:00:07.979236 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 399/814] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:07 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1362 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:08.813728 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-c14f71ba-92c4-43db-b4d0-3e1b50d9c539 req-4a9fb542-dcbe-483a-aa02-fb4d002ef53d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d7eb8d0-d6c0-4416-9d51-b8e7c732800e", "tag": "a3b20ac7-62d6-43cf-93f6-146ca5fdecbe"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:00:08.851980 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-c14f71ba-92c4-43db-b4d0-3e1b50d9c539 req-4a9fb542-dcbe-483a-aa02-fb4d002ef53d service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:08.860296 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-c14f71ba-92c4-43db-b4d0-3e1b50d9c539 req-4a9fb542-dcbe-483a-aa02-fb4d002ef53d service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:08.882526 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-c14f71ba-92c4-43db-b4d0-3e1b50d9c539 req-4a9fb542-dcbe-483a-aa02-fb4d002ef53d service nova] Creating event network-changed:a3b20ac7-62d6-43cf-93f6-146ca5fdecbe for instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e on hv-cinder-83697 Jun 20 15:00:08.889021 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-c14f71ba-92c4-43db-b4d0-3e1b50d9c539 req-4a9fb542-dcbe-483a-aa02-fb4d002ef53d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079884 Jun 20 15:00:08.890657 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 416/815] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:00:08.995775 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2c02eb34-d16c-430b-91ab-b0d91a0881fe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:08.996380 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2c02eb34-d16c-430b-91ab-b0d91a0881fe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:09.011725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2c02eb34-d16c-430b-91ab-b0d91a0881fe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:09.012427 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2c02eb34-d16c-430b-91ab-b0d91a0881fe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:09.013561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2c02eb34-d16c-430b-91ab-b0d91a0881fe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:09.014150 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2c02eb34-d16c-430b-91ab-b0d91a0881fe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:09.295158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2c02eb34-d16c-430b-91ab-b0d91a0881fe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:09.304498 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2c02eb34-d16c-430b-91ab-b0d91a0881fe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1362 microversion: 2.1 time: 0.312957 Jun 20 15:00:09.305259 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 400/816] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:08 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:10.323791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7e16f0ff-b475-464e-948c-46221ced30af tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:10.325227 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7e16f0ff-b475-464e-948c-46221ced30af tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:10.340193 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7e16f0ff-b475-464e-948c-46221ced30af tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:10.340736 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7e16f0ff-b475-464e-948c-46221ced30af tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:10.341729 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7e16f0ff-b475-464e-948c-46221ced30af tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:10.342161 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7e16f0ff-b475-464e-948c-46221ced30af tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:10.476901 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7e16f0ff-b475-464e-948c-46221ced30af tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:10.485097 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7e16f0ff-b475-464e-948c-46221ced30af tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1362 microversion: 2.1 time: 0.166261 Jun 20 15:00:10.485702 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 417/817] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:10 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:11.505276 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-247622a6-482a-43e6-babd-49aaf2319c0d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:11.506452 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-247622a6-482a-43e6-babd-49aaf2319c0d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:11.514130 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-247622a6-482a-43e6-babd-49aaf2319c0d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:11.514711 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-247622a6-482a-43e6-babd-49aaf2319c0d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:11.515768 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-247622a6-482a-43e6-babd-49aaf2319c0d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:11.516193 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-247622a6-482a-43e6-babd-49aaf2319c0d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:11.697502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-247622a6-482a-43e6-babd-49aaf2319c0d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:11.710412 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-247622a6-482a-43e6-babd-49aaf2319c0d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1362 microversion: 2.1 time: 0.206957 Jun 20 15:00:11.710412 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 401/818] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:11 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:12.727144 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-dfb1e136-9680-4e20-a8d2-42fcab325014 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:12.727837 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-dfb1e136-9680-4e20-a8d2-42fcab325014 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:12.735505 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dfb1e136-9680-4e20-a8d2-42fcab325014 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:12.735951 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dfb1e136-9680-4e20-a8d2-42fcab325014 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:12.736735 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dfb1e136-9680-4e20-a8d2-42fcab325014 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:12.737172 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dfb1e136-9680-4e20-a8d2-42fcab325014 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:12.880429 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-dfb1e136-9680-4e20-a8d2-42fcab325014 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:12.889821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-dfb1e136-9680-4e20-a8d2-42fcab325014 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1362 microversion: 2.1 time: 0.166957 Jun 20 15:00:12.890387 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 418/819] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:12 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:13.656982 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-9df20851-3a10-4d9d-b960-f07aeee9b506 req-6bd444aa-b389-4fbd-9cdb-968fe0d2adc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d7eb8d0-d6c0-4416-9d51-b8e7c732800e", "name": "network-vif-plugged", "status": "completed", "tag": "a3b20ac7-62d6-43cf-93f6-146ca5fdecbe"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:00:13.667416 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-9df20851-3a10-4d9d-b960-f07aeee9b506 req-6bd444aa-b389-4fbd-9cdb-968fe0d2adc1 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:13.668728 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-9df20851-3a10-4d9d-b960-f07aeee9b506 req-6bd444aa-b389-4fbd-9cdb-968fe0d2adc1 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:13.681444 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-9df20851-3a10-4d9d-b960-f07aeee9b506 req-6bd444aa-b389-4fbd-9cdb-968fe0d2adc1 service nova] Creating event network-vif-plugged:a3b20ac7-62d6-43cf-93f6-146ca5fdecbe for instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e on hv-cinder-83697 Jun 20 15:00:13.687380 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-9df20851-3a10-4d9d-b960-f07aeee9b506 req-6bd444aa-b389-4fbd-9cdb-968fe0d2adc1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034472 Jun 20 15:00:13.687981 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 402/820] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:00:13.907450 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-a29c713c-afc4-41eb-9e05-f5446c5c86c6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:13.908041 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-a29c713c-afc4-41eb-9e05-f5446c5c86c6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:13.914777 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a29c713c-afc4-41eb-9e05-f5446c5c86c6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:13.915481 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a29c713c-afc4-41eb-9e05-f5446c5c86c6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:13.916251 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a29c713c-afc4-41eb-9e05-f5446c5c86c6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:13.916676 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a29c713c-afc4-41eb-9e05-f5446c5c86c6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:14.061693 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a29c713c-afc4-41eb-9e05-f5446c5c86c6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:14.069384 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-a29c713c-afc4-41eb-9e05-f5446c5c86c6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1362 microversion: 2.1 time: 0.165953 Jun 20 15:00:14.069925 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 419/821] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:13 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:15.091861 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-8452aae9-a0c2-4fe5-bdcd-3653e064c7d6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:15.092774 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-8452aae9-a0c2-4fe5-bdcd-3653e064c7d6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:15.103445 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8452aae9-a0c2-4fe5-bdcd-3653e064c7d6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:15.104184 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8452aae9-a0c2-4fe5-bdcd-3653e064c7d6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:15.105543 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8452aae9-a0c2-4fe5-bdcd-3653e064c7d6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:15.106282 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8452aae9-a0c2-4fe5-bdcd-3653e064c7d6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:15.242028 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-8452aae9-a0c2-4fe5-bdcd-3653e064c7d6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:15.250710 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-8452aae9-a0c2-4fe5-bdcd-3653e064c7d6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1362 microversion: 2.1 time: 0.166473 Jun 20 15:00:15.251612 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 403/822] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:15 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:16.273325 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7ee0be6d-1212-4cea-ac8e-da9d5578107f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:16.274272 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7ee0be6d-1212-4cea-ac8e-da9d5578107f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:16.278059 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:16.279134 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=10 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:16.286685 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7ee0be6d-1212-4cea-ac8e-da9d5578107f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:16.287129 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7ee0be6d-1212-4cea-ac8e-da9d5578107f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:16.287920 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7ee0be6d-1212-4cea-ac8e-da9d5578107f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:16.288352 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7ee0be6d-1212-4cea-ac8e-da9d5578107f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:16.425457 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7ee0be6d-1212-4cea-ac8e-da9d5578107f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:16.433668 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7ee0be6d-1212-4cea-ac8e-da9d5578107f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1547 microversion: 2.1 time: 0.167519 Jun 20 15:00:16.434870 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 420/823] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:16 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1547 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:16.450764 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-585c9a65-87e6-4c5f-8c0f-4e1540ea22b1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:16.451274 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-585c9a65-87e6-4c5f-8c0f-4e1540ea22b1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:16.453295 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=6 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:16.459174 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-585c9a65-87e6-4c5f-8c0f-4e1540ea22b1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:16.459618 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-585c9a65-87e6-4c5f-8c0f-4e1540ea22b1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:16.460372 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-585c9a65-87e6-4c5f-8c0f-4e1540ea22b1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:16.460831 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-585c9a65-87e6-4c5f-8c0f-4e1540ea22b1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:16.546805 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-585c9a65-87e6-4c5f-8c0f-4e1540ea22b1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099663 Jun 20 15:00:16.547718 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 404/824] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 15:00:16 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:00:17.488322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-757d2eec-dea1-45c8-81fe-598c6f628b57 req-76014cf6-db31-497f-9009-ac32ee8d9930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d7eb8d0-d6c0-4416-9d51-b8e7c732800e", "tag": "a3b20ac7-62d6-43cf-93f6-146ca5fdecbe"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:00:17.497061 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-757d2eec-dea1-45c8-81fe-598c6f628b57 req-76014cf6-db31-497f-9009-ac32ee8d9930 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:17.497500 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-757d2eec-dea1-45c8-81fe-598c6f628b57 req-76014cf6-db31-497f-9009-ac32ee8d9930 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:17.510641 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-757d2eec-dea1-45c8-81fe-598c6f628b57 req-76014cf6-db31-497f-9009-ac32ee8d9930 service nova] Creating event network-changed:a3b20ac7-62d6-43cf-93f6-146ca5fdecbe for instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e on hv-cinder-83697 Jun 20 15:00:17.516060 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-757d2eec-dea1-45c8-81fe-598c6f628b57 req-76014cf6-db31-497f-9009-ac32ee8d9930 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031597 Jun 20 15:00:17.516960 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 421/825] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:00:21.244682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1400519656", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1858792678", "security_groups": [{"name": "tempest-secgroup-smoke-930448680"}], "networks": [{"uuid": "aaa050c0-7567-4d7e-9fda-be765cd4b29a"}], "block_device_mapping_v2": [{"uuid": "b7222467-bd84-4188-abf6-958e40294697", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:00:21.363395 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.network.neutron [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] validate_networks() for [('aaa050c0-7567-4d7e-9fda-be765cd4b29a', None, None, None, None, None)] {{(pid=123978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 15:00:21.758315 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Flavor limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 15:00:21.759037 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Image limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 15:00:21.759763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Flavor pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 15:00:21.760474 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Image pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 15:00:21.761426 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 15:00:21.773582 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:21.774027 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:21.774812 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:21.775235 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:21.792848 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Getting quotas for project f29cab4870474548b98c3a81a3aa8031. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 15:00:21.797259 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Getting quotas for user 5422c53c285f4e33998f7aabe528750c and project f29cab4870474548b98c3a81a3aa8031. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 15:00:21.858462 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Going to run 1 instances... {{(pid=123978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 15:00:21.862172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b7222467-bd84-4188-abf6-958e40294697',volume_size=None,volume_type=None)] {{(pid=123978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 15:00:22.010701 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-273c7cf7-a918-44b2-bfe9-234c645b16a4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.770270 Jun 20 15:00:22.011271 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 405/826] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 15:00:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 15:00:22.023237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-5f579864-9ff3-4565-89d3-6187724cec30 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:22.024081 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-5f579864-9ff3-4565-89d3-6187724cec30 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:22.084023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-5f579864-9ff3-4565-89d3-6187724cec30 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:22.091160 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-5f579864-9ff3-4565-89d3-6187724cec30 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1089 microversion: 2.1 time: 0.072747 Jun 20 15:00:22.091725 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 422/827] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:22 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:23.109353 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e2c84183-75b2-4089-a0d1-585ecd644b03 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:23.110240 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e2c84183-75b2-4089-a0d1-585ecd644b03 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:23.117554 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e2c84183-75b2-4089-a0d1-585ecd644b03 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:23.118137 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e2c84183-75b2-4089-a0d1-585ecd644b03 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:23.119045 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e2c84183-75b2-4089-a0d1-585ecd644b03 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:23.119592 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e2c84183-75b2-4089-a0d1-585ecd644b03 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:23.358939 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-e2c84183-75b2-4089-a0d1-585ecd644b03 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:23.366782 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e2c84183-75b2-4089-a0d1-585ecd644b03 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1205 microversion: 2.1 time: 0.262153 Jun 20 15:00:23.367339 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 406/828] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:23 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1205 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 15:00:24.384107 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-764c7d47-6787-4cc4-b1b1-75f1e8330e54 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:24.384889 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-764c7d47-6787-4cc4-b1b1-75f1e8330e54 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:24.392539 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-764c7d47-6787-4cc4-b1b1-75f1e8330e54 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:24.393122 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-764c7d47-6787-4cc4-b1b1-75f1e8330e54 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:24.393970 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-764c7d47-6787-4cc4-b1b1-75f1e8330e54 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:24.394330 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-764c7d47-6787-4cc4-b1b1-75f1e8330e54 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:24.541906 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-764c7d47-6787-4cc4-b1b1-75f1e8330e54 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:24.550328 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-764c7d47-6787-4cc4-b1b1-75f1e8330e54 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1260 microversion: 2.1 time: 0.169974 Jun 20 15:00:24.550948 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 423/829] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:24 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:24.676154 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-3742ccf4-7254-4e4c-adbb-2b897fdc770e req-07918963-d0fe-4f3d-8884-8da44a03a912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f9ab17-ba92-425c-b79e-ace0b9666352", "tag": "39c85ef4-03a3-4009-bf95-8bd7df3230ea"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:00:24.713552 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-3742ccf4-7254-4e4c-adbb-2b897fdc770e req-07918963-d0fe-4f3d-8884-8da44a03a912 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:24.714216 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-3742ccf4-7254-4e4c-adbb-2b897fdc770e req-07918963-d0fe-4f3d-8884-8da44a03a912 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:24.726462 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-3742ccf4-7254-4e4c-adbb-2b897fdc770e req-07918963-d0fe-4f3d-8884-8da44a03a912 service nova] Creating event network-changed:39c85ef4-03a3-4009-bf95-8bd7df3230ea for instance 69f9ab17-ba92-425c-b79e-ace0b9666352 on hv-cinder-83697 Jun 20 15:00:24.731862 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-3742ccf4-7254-4e4c-adbb-2b897fdc770e req-07918963-d0fe-4f3d-8884-8da44a03a912 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059975 Jun 20 15:00:24.733135 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 407/830] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:00:25.568249 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-4e100cae-0c63-474f-9579-21a85d715763 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:25.568915 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-4e100cae-0c63-474f-9579-21a85d715763 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:25.575559 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4e100cae-0c63-474f-9579-21a85d715763 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:25.576009 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4e100cae-0c63-474f-9579-21a85d715763 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:25.576733 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4e100cae-0c63-474f-9579-21a85d715763 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:25.577225 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4e100cae-0c63-474f-9579-21a85d715763 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:25.716049 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-4e100cae-0c63-474f-9579-21a85d715763 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:25.723803 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-4e100cae-0c63-474f-9579-21a85d715763 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1260 microversion: 2.1 time: 0.159680 Jun 20 15:00:25.724385 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 424/831] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:25 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:26.741932 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-84a59d32-490b-4d21-84ae-0d346b670d00 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:26.742632 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-84a59d32-490b-4d21-84ae-0d346b670d00 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:26.750300 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-84a59d32-490b-4d21-84ae-0d346b670d00 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:26.750735 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-84a59d32-490b-4d21-84ae-0d346b670d00 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:26.751497 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-84a59d32-490b-4d21-84ae-0d346b670d00 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:26.751915 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-84a59d32-490b-4d21-84ae-0d346b670d00 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:27.058519 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-84a59d32-490b-4d21-84ae-0d346b670d00 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:27.066573 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-84a59d32-490b-4d21-84ae-0d346b670d00 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1260 microversion: 2.1 time: 0.329014 Jun 20 15:00:27.067132 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 408/832] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:26 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1260 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:28.086540 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-a212d85d-f1ad-40dd-a57c-d932b4a218e8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:28.087508 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-a212d85d-f1ad-40dd-a57c-d932b4a218e8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:28.097776 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a212d85d-f1ad-40dd-a57c-d932b4a218e8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:28.098220 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a212d85d-f1ad-40dd-a57c-d932b4a218e8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:28.098975 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a212d85d-f1ad-40dd-a57c-d932b4a218e8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:28.099403 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-a212d85d-f1ad-40dd-a57c-d932b4a218e8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:28.237700 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a212d85d-f1ad-40dd-a57c-d932b4a218e8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:28.245612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-a212d85d-f1ad-40dd-a57c-d932b4a218e8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1260 microversion: 2.1 time: 0.165297 Jun 20 15:00:28.246195 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 425/833] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:28 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:29.266036 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-75ebbd9b-aeee-4c92-991a-b6249cb68900 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:29.266777 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-75ebbd9b-aeee-4c92-991a-b6249cb68900 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:29.277368 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-75ebbd9b-aeee-4c92-991a-b6249cb68900 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:29.277981 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-75ebbd9b-aeee-4c92-991a-b6249cb68900 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:29.279162 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-75ebbd9b-aeee-4c92-991a-b6249cb68900 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:29.279666 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-75ebbd9b-aeee-4c92-991a-b6249cb68900 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:29.417611 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-75ebbd9b-aeee-4c92-991a-b6249cb68900 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:29.425556 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-75ebbd9b-aeee-4c92-991a-b6249cb68900 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1260 microversion: 2.1 time: 0.165846 Jun 20 15:00:29.426088 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 409/834] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:29 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:30.447647 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ea9c16a2-bc64-49a9-8ba3-aca085671964 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:30.448678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ea9c16a2-bc64-49a9-8ba3-aca085671964 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:30.459244 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ea9c16a2-bc64-49a9-8ba3-aca085671964 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:30.459715 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ea9c16a2-bc64-49a9-8ba3-aca085671964 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:30.460474 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ea9c16a2-bc64-49a9-8ba3-aca085671964 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:30.460945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ea9c16a2-bc64-49a9-8ba3-aca085671964 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:30.601667 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ea9c16a2-bc64-49a9-8ba3-aca085671964 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:30.609217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ea9c16a2-bc64-49a9-8ba3-aca085671964 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1260 microversion: 2.1 time: 0.168489 Jun 20 15:00:30.609790 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 426/835] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:30 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:31.630341 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ab4a68a5-9f45-483a-915d-bac61747d95a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:31.632639 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ab4a68a5-9f45-483a-915d-bac61747d95a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:31.638198 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ab4a68a5-9f45-483a-915d-bac61747d95a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:31.638716 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ab4a68a5-9f45-483a-915d-bac61747d95a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:31.639593 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ab4a68a5-9f45-483a-915d-bac61747d95a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:31.640097 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ab4a68a5-9f45-483a-915d-bac61747d95a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:31.780825 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ab4a68a5-9f45-483a-915d-bac61747d95a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:31.783154 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:31.789878 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ab4a68a5-9f45-483a-915d-bac61747d95a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1260 microversion: 2.1 time: 0.165861 Jun 20 15:00:31.790441 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 410/836] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:31 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:32.810852 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7469d6af-241c-4fe7-8501-917cfb8b314f tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:32.811808 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7469d6af-241c-4fe7-8501-917cfb8b314f tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:32.815846 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:32.816964 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:32.827079 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7469d6af-241c-4fe7-8501-917cfb8b314f tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:32.827645 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7469d6af-241c-4fe7-8501-917cfb8b314f tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:32.828785 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7469d6af-241c-4fe7-8501-917cfb8b314f tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:32.829429 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7469d6af-241c-4fe7-8501-917cfb8b314f tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:32.834341 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=61 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:32.988615 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7469d6af-241c-4fe7-8501-917cfb8b314f tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:32.996653 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7469d6af-241c-4fe7-8501-917cfb8b314f tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1260 microversion: 2.1 time: 0.192718 Jun 20 15:00:32.997270 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 427/837] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:32 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:34.017752 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3391424f-6a75-4d29-acf3-1981afa738cf tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:34.018551 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-3391424f-6a75-4d29-acf3-1981afa738cf tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:34.021437 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=6 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:34.023119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:34.030233 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3391424f-6a75-4d29-acf3-1981afa738cf tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:34.030763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3391424f-6a75-4d29-acf3-1981afa738cf tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:34.031533 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3391424f-6a75-4d29-acf3-1981afa738cf tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:34.031968 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3391424f-6a75-4d29-acf3-1981afa738cf tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:34.035324 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=59 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:34.166885 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3391424f-6a75-4d29-acf3-1981afa738cf tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:34.174598 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-3391424f-6a75-4d29-acf3-1981afa738cf tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1260 microversion: 2.1 time: 0.163370 Jun 20 15:00:34.175166 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 411/838] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:34 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:35.195700 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ed13c573-340c-4f91-8ca1-8ee784f04831 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:35.196416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ed13c573-340c-4f91-8ca1-8ee784f04831 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:35.205058 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ed13c573-340c-4f91-8ca1-8ee784f04831 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:35.205611 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ed13c573-340c-4f91-8ca1-8ee784f04831 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:35.206552 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ed13c573-340c-4f91-8ca1-8ee784f04831 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:35.207085 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ed13c573-340c-4f91-8ca1-8ee784f04831 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:35.342772 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ed13c573-340c-4f91-8ca1-8ee784f04831 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:35.350427 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ed13c573-340c-4f91-8ca1-8ee784f04831 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1260 microversion: 2.1 time: 0.160632 Jun 20 15:00:35.350961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 428/839] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:35 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:35.759185 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-933874cc-f998-452c-8174-8454d75ebe7e req-d03584af-83e5-444b-afd8-2e48ea4fd4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f9ab17-ba92-425c-b79e-ace0b9666352", "name": "network-vif-plugged", "status": "completed", "tag": "39c85ef4-03a3-4009-bf95-8bd7df3230ea"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:00:35.768457 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-933874cc-f998-452c-8174-8454d75ebe7e req-d03584af-83e5-444b-afd8-2e48ea4fd4c7 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:35.768917 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-933874cc-f998-452c-8174-8454d75ebe7e req-d03584af-83e5-444b-afd8-2e48ea4fd4c7 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:35.780629 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-933874cc-f998-452c-8174-8454d75ebe7e req-d03584af-83e5-444b-afd8-2e48ea4fd4c7 service nova] Creating event network-vif-plugged:39c85ef4-03a3-4009-bf95-8bd7df3230ea for instance 69f9ab17-ba92-425c-b79e-ace0b9666352 on hv-cinder-83697 Jun 20 15:00:35.785720 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-933874cc-f998-452c-8174-8454d75ebe7e req-d03584af-83e5-444b-afd8-2e48ea4fd4c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030439 Jun 20 15:00:35.786514 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 412/840] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:00:36.375862 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-efc1e3db-61ee-49cc-935d-993af1770236 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:36.376765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-efc1e3db-61ee-49cc-935d-993af1770236 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:36.385145 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efc1e3db-61ee-49cc-935d-993af1770236 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:36.385609 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efc1e3db-61ee-49cc-935d-993af1770236 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:36.386340 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efc1e3db-61ee-49cc-935d-993af1770236 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:36.386767 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-efc1e3db-61ee-49cc-935d-993af1770236 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:36.536499 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-efc1e3db-61ee-49cc-935d-993af1770236 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:36.547942 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-efc1e3db-61ee-49cc-935d-993af1770236 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1260 microversion: 2.1 time: 0.178535 Jun 20 15:00:36.548698 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 429/841] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:36 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:37.572079 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-141b5947-714f-4c8f-acba-375cfa683b56 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:37.572785 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-141b5947-714f-4c8f-acba-375cfa683b56 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:37.578991 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-141b5947-714f-4c8f-acba-375cfa683b56 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:37.579426 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-141b5947-714f-4c8f-acba-375cfa683b56 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:37.580178 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-141b5947-714f-4c8f-acba-375cfa683b56 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:37.580608 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-141b5947-714f-4c8f-acba-375cfa683b56 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:37.714634 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-141b5947-714f-4c8f-acba-375cfa683b56 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:37.722337 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-141b5947-714f-4c8f-acba-375cfa683b56 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1445 microversion: 2.1 time: 0.155404 Jun 20 15:00:37.722895 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 413/842] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:37 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:37.738584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-f2d5876f-11e5-4a7f-b6e4-c41da20a58cc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:37.739191 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-f2d5876f-11e5-4a7f-b6e4-c41da20a58cc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:37.746270 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f2d5876f-11e5-4a7f-b6e4-c41da20a58cc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:37.746712 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f2d5876f-11e5-4a7f-b6e4-c41da20a58cc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:37.747466 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f2d5876f-11e5-4a7f-b6e4-c41da20a58cc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:37.747889 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-f2d5876f-11e5-4a7f-b6e4-c41da20a58cc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:37.895709 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-f2d5876f-11e5-4a7f-b6e4-c41da20a58cc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:00:37.903974 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-f2d5876f-11e5-4a7f-b6e4-c41da20a58cc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1445 microversion: 2.1 time: 0.169304 Jun 20 15:00:37.904556 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 430/843] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:00:37 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1445 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:00:39.551663 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-0e930457-4ee4-4625-bf94-c1d4e37315f8 req-f8af0442-ce62-4e7b-9f37-0661c4a4ef12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f9ab17-ba92-425c-b79e-ace0b9666352", "tag": "39c85ef4-03a3-4009-bf95-8bd7df3230ea"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:00:39.561248 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-0e930457-4ee4-4625-bf94-c1d4e37315f8 req-f8af0442-ce62-4e7b-9f37-0661c4a4ef12 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:39.561677 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-0e930457-4ee4-4625-bf94-c1d4e37315f8 req-f8af0442-ce62-4e7b-9f37-0661c4a4ef12 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:39.572862 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-0e930457-4ee4-4625-bf94-c1d4e37315f8 req-f8af0442-ce62-4e7b-9f37-0661c4a4ef12 service nova] Creating event network-changed:39c85ef4-03a3-4009-bf95-8bd7df3230ea for instance 69f9ab17-ba92-425c-b79e-ace0b9666352 on hv-cinder-83697 Jun 20 15:00:39.577966 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-0e930457-4ee4-4625-bf94-c1d4e37315f8 req-f8af0442-ce62-4e7b-9f37-0661c4a4ef12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030041 Jun 20 15:00:39.578860 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 414/844] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:00:53.505257 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-3035b13a-37c3-4288-a3b8-85013e655c37 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:00:53.505973 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-3035b13a-37c3-4288-a3b8-85013e655c37 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:53.508277 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=7 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:53.508960 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=23 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:53.515051 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3035b13a-37c3-4288-a3b8-85013e655c37 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:53.515495 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3035b13a-37c3-4288-a3b8-85013e655c37 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:53.516256 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3035b13a-37c3-4288-a3b8-85013e655c37 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:53.516684 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-3035b13a-37c3-4288-a3b8-85013e655c37 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:53.540687 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-3035b13a-37c3-4288-a3b8-85013e655c37 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/ips" status: 200 len: 145 microversion: 2.1 time: 0.039332 Jun 20 15:00:53.541277 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 431/845] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 15:00:53 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:00:56.084650 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=7 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:56.085415 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=15 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:56.089696 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-65c37be5-f79e-47f6-9b43-6f47043751d0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5979d31-7de3-4153-807d-86996fc760e2"}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:00:56.090838 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-65c37be5-f79e-47f6-9b43-6f47043751d0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:00:56.097750 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-65c37be5-f79e-47f6-9b43-6f47043751d0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:56.098189 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-65c37be5-f79e-47f6-9b43-6f47043751d0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:56.098931 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-65c37be5-f79e-47f6-9b43-6f47043751d0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:00:56.099352 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-65c37be5-f79e-47f6-9b43-6f47043751d0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:00:56.360765 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-65c37be5-f79e-47f6-9b43-6f47043751d0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "POST /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277394 Jun 20 15:00:56.364758 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 415/846] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 15:00:56 2022] POST /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:01:02.853048 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b64462f4-4c47-4769-ae68-3e93df899684 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:01:02.861180 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b64462f4-4c47-4769-ae68-3e93df899684 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:02.861613 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b64462f4-4c47-4769-ae68-3e93df899684 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:02.920797 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-b64462f4-4c47-4769-ae68-3e93df899684 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Going to try to stop instance {{(pid=123979) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 15:01:02.969551 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-b64462f4-4c47-4769-ae68-3e93df899684 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "POST /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/action" status: 202 len: 0 microversion: 2.1 time: 0.120429 Jun 20 15:01:02.970295 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 432/847] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 15:01:02 2022] POST /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 15:01:02.979417 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-663d97cc-abb1-49bb-8ff2-d25fee5805d4 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:02.980109 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-663d97cc-abb1-49bb-8ff2-d25fee5805d4 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:02.986615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-663d97cc-abb1-49bb-8ff2-d25fee5805d4 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:02.987102 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-663d97cc-abb1-49bb-8ff2-d25fee5805d4 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:02.987902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-663d97cc-abb1-49bb-8ff2-d25fee5805d4 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:02.988308 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-663d97cc-abb1-49bb-8ff2-d25fee5805d4 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:03.125038 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-663d97cc-abb1-49bb-8ff2-d25fee5805d4 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:03.133591 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-663d97cc-abb1-49bb-8ff2-d25fee5805d4 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1722 microversion: 2.1 time: 0.158828 Jun 20 15:01:03.134176 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 416/848] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:02 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:04.157430 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-05a5ee9f-88ff-449a-906f-8ef931fb83ee tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:04.159018 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-05a5ee9f-88ff-449a-906f-8ef931fb83ee tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:04.169782 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-05a5ee9f-88ff-449a-906f-8ef931fb83ee tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:04.170523 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-05a5ee9f-88ff-449a-906f-8ef931fb83ee tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:04.171769 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-05a5ee9f-88ff-449a-906f-8ef931fb83ee tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:04.172486 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-05a5ee9f-88ff-449a-906f-8ef931fb83ee tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:04.313139 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-05a5ee9f-88ff-449a-906f-8ef931fb83ee tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:04.321646 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-05a5ee9f-88ff-449a-906f-8ef931fb83ee tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1722 microversion: 2.1 time: 0.172299 Jun 20 15:01:04.322217 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 433/849] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:04 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:05.343231 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7d802e13-8ab7-4912-ba7a-8036199338fd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:05.344106 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7d802e13-8ab7-4912-ba7a-8036199338fd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:05.355606 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7d802e13-8ab7-4912-ba7a-8036199338fd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:05.356344 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7d802e13-8ab7-4912-ba7a-8036199338fd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:05.357653 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7d802e13-8ab7-4912-ba7a-8036199338fd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:05.358365 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7d802e13-8ab7-4912-ba7a-8036199338fd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:05.494091 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-7d802e13-8ab7-4912-ba7a-8036199338fd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:05.503066 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7d802e13-8ab7-4912-ba7a-8036199338fd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1722 microversion: 2.1 time: 0.166618 Jun 20 15:01:05.503722 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 417/850] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:05 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:06.529261 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1ea46daf-046a-43a8-b6a4-4f88b580d0f5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:06.529898 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-1ea46daf-046a-43a8-b6a4-4f88b580d0f5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:06.538521 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1ea46daf-046a-43a8-b6a4-4f88b580d0f5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:06.538991 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1ea46daf-046a-43a8-b6a4-4f88b580d0f5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:06.539753 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1ea46daf-046a-43a8-b6a4-4f88b580d0f5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:06.540185 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1ea46daf-046a-43a8-b6a4-4f88b580d0f5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:06.673001 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-1ea46daf-046a-43a8-b6a4-4f88b580d0f5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:06.681072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1ea46daf-046a-43a8-b6a4-4f88b580d0f5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1722 microversion: 2.1 time: 0.157628 Jun 20 15:01:06.681617 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 434/851] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:06 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:07.702504 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-318ed694-a675-4b6b-abe3-6b4c1f6b72f0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:07.703451 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-318ed694-a675-4b6b-abe3-6b4c1f6b72f0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:07.711872 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-318ed694-a675-4b6b-abe3-6b4c1f6b72f0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:07.712312 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-318ed694-a675-4b6b-abe3-6b4c1f6b72f0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:07.713099 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-318ed694-a675-4b6b-abe3-6b4c1f6b72f0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:07.713522 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-318ed694-a675-4b6b-abe3-6b4c1f6b72f0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:07.849864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-318ed694-a675-4b6b-abe3-6b4c1f6b72f0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:07.858818 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-318ed694-a675-4b6b-abe3-6b4c1f6b72f0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1722 microversion: 2.1 time: 0.162803 Jun 20 15:01:07.859424 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 418/852] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:07 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:08.879218 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-10ca4443-a4d8-49c4-8239-4eca89ef2762 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:08.879767 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-10ca4443-a4d8-49c4-8239-4eca89ef2762 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:08.886265 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-10ca4443-a4d8-49c4-8239-4eca89ef2762 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:08.886701 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-10ca4443-a4d8-49c4-8239-4eca89ef2762 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:08.887447 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-10ca4443-a4d8-49c4-8239-4eca89ef2762 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:08.887868 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-10ca4443-a4d8-49c4-8239-4eca89ef2762 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:09.029515 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-10ca4443-a4d8-49c4-8239-4eca89ef2762 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:09.038329 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-10ca4443-a4d8-49c4-8239-4eca89ef2762 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1722 microversion: 2.1 time: 0.165437 Jun 20 15:01:09.038888 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 435/853] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:08 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:10.056021 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-dc884424-7961-45af-b6ff-753a16e95ec7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:10.056598 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-dc884424-7961-45af-b6ff-753a16e95ec7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:10.063919 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dc884424-7961-45af-b6ff-753a16e95ec7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:10.064372 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dc884424-7961-45af-b6ff-753a16e95ec7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:10.065223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dc884424-7961-45af-b6ff-753a16e95ec7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:10.065647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-dc884424-7961-45af-b6ff-753a16e95ec7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:10.209329 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-dc884424-7961-45af-b6ff-753a16e95ec7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:10.218320 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-dc884424-7961-45af-b6ff-753a16e95ec7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1722 microversion: 2.1 time: 0.166260 Jun 20 15:01:10.218917 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 419/854] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:10 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:11.238764 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-da8b10b9-391b-430a-8be5-7adcdfafe25d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:11.239639 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-da8b10b9-391b-430a-8be5-7adcdfafe25d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:11.249336 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-da8b10b9-391b-430a-8be5-7adcdfafe25d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:11.249795 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-da8b10b9-391b-430a-8be5-7adcdfafe25d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:11.250974 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-da8b10b9-391b-430a-8be5-7adcdfafe25d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:11.251660 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-da8b10b9-391b-430a-8be5-7adcdfafe25d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:11.396197 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-da8b10b9-391b-430a-8be5-7adcdfafe25d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:11.404646 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-da8b10b9-391b-430a-8be5-7adcdfafe25d tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1722 microversion: 2.1 time: 0.171867 Jun 20 15:01:11.405397 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 436/855] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:11 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:12.427050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f64846ad-ce4f-42b0-925c-8931d9eba0c2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:12.427618 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f64846ad-ce4f-42b0-925c-8931d9eba0c2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:12.435135 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f64846ad-ce4f-42b0-925c-8931d9eba0c2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:12.435572 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f64846ad-ce4f-42b0-925c-8931d9eba0c2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:12.436321 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f64846ad-ce4f-42b0-925c-8931d9eba0c2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:12.436748 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f64846ad-ce4f-42b0-925c-8931d9eba0c2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:12.570666 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f64846ad-ce4f-42b0-925c-8931d9eba0c2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:12.578977 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f64846ad-ce4f-42b0-925c-8931d9eba0c2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1722 microversion: 2.1 time: 0.158582 Jun 20 15:01:12.579583 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 420/856] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:12 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:13.596422 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-cc686de4-82a1-4eb4-aaa9-30cce3c6480a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:13.597246 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-cc686de4-82a1-4eb4-aaa9-30cce3c6480a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:13.603914 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cc686de4-82a1-4eb4-aaa9-30cce3c6480a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:13.604387 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cc686de4-82a1-4eb4-aaa9-30cce3c6480a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:13.605147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cc686de4-82a1-4eb4-aaa9-30cce3c6480a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:13.605581 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cc686de4-82a1-4eb4-aaa9-30cce3c6480a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:13.742378 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-cc686de4-82a1-4eb4-aaa9-30cce3c6480a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:13.754763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-cc686de4-82a1-4eb4-aaa9-30cce3c6480a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1722 microversion: 2.1 time: 0.161997 Jun 20 15:01:13.755537 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 437/857] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:13 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:14.776517 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ebb3fdaa-0a6e-4dab-ae9d-5b16908922a7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:14.777537 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ebb3fdaa-0a6e-4dab-ae9d-5b16908922a7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:14.788583 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ebb3fdaa-0a6e-4dab-ae9d-5b16908922a7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:14.789078 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ebb3fdaa-0a6e-4dab-ae9d-5b16908922a7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:14.789835 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ebb3fdaa-0a6e-4dab-ae9d-5b16908922a7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:14.790271 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ebb3fdaa-0a6e-4dab-ae9d-5b16908922a7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:14.935355 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ebb3fdaa-0a6e-4dab-ae9d-5b16908922a7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:14.946601 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ebb3fdaa-0a6e-4dab-ae9d-5b16908922a7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1722 microversion: 2.1 time: 0.176719 Jun 20 15:01:14.947179 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 421/858] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:14 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:15.965878 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9d449a6c-33d4-4c05-9b9d-9e1a604e6d2e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:15.966449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9d449a6c-33d4-4c05-9b9d-9e1a604e6d2e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:15.973880 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9d449a6c-33d4-4c05-9b9d-9e1a604e6d2e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:15.974325 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9d449a6c-33d4-4c05-9b9d-9e1a604e6d2e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:15.975085 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9d449a6c-33d4-4c05-9b9d-9e1a604e6d2e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:15.975516 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9d449a6c-33d4-4c05-9b9d-9e1a604e6d2e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:16.111808 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9d449a6c-33d4-4c05-9b9d-9e1a604e6d2e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:16.121219 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9d449a6c-33d4-4c05-9b9d-9e1a604e6d2e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1722 microversion: 2.1 time: 0.159433 Jun 20 15:01:16.121765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 438/859] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:15 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:17.143408 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-9900fc95-2db5-4865-b07b-f117e3c98ac0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:17.144400 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-9900fc95-2db5-4865-b07b-f117e3c98ac0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:17.155536 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9900fc95-2db5-4865-b07b-f117e3c98ac0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:17.156270 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9900fc95-2db5-4865-b07b-f117e3c98ac0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:17.157549 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9900fc95-2db5-4865-b07b-f117e3c98ac0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:17.158256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-9900fc95-2db5-4865-b07b-f117e3c98ac0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:17.292127 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-9900fc95-2db5-4865-b07b-f117e3c98ac0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:17.300478 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-9900fc95-2db5-4865-b07b-f117e3c98ac0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1722 microversion: 2.1 time: 0.164547 Jun 20 15:01:17.301072 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 422/860] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:17 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:18.317450 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d3136b34-7862-42e1-940e-3bb022742fca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:18.318004 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d3136b34-7862-42e1-940e-3bb022742fca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:18.324452 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d3136b34-7862-42e1-940e-3bb022742fca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:18.324933 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d3136b34-7862-42e1-940e-3bb022742fca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:18.325698 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d3136b34-7862-42e1-940e-3bb022742fca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:18.326120 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d3136b34-7862-42e1-940e-3bb022742fca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:18.476444 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d3136b34-7862-42e1-940e-3bb022742fca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:18.484945 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d3136b34-7862-42e1-940e-3bb022742fca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1699 microversion: 2.1 time: 0.171514 Jun 20 15:01:18.485657 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 439/861] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:18 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1699 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:18.504141 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-746bccdc-2e10-4bb5-ae7f-a9712424f684 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:01:18.512013 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-746bccdc-2e10-4bb5-ae7f-a9712424f684 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:18.512463 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-746bccdc-2e10-4bb5-ae7f-a9712424f684 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:18.577103 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-746bccdc-2e10-4bb5-ae7f-a9712424f684 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Going to try to start instance {{(pid=123978) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 15:01:18.628345 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-746bccdc-2e10-4bb5-ae7f-a9712424f684 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "POST /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/action" status: 202 len: 0 microversion: 2.1 time: 0.127606 Jun 20 15:01:18.629466 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 423/862] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 15:01:18 2022] POST /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 15:01:18.638189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-cd54e5d8-5583-4d0d-bc74-d4c17f14006b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:18.638806 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-cd54e5d8-5583-4d0d-bc74-d4c17f14006b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:18.646723 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cd54e5d8-5583-4d0d-bc74-d4c17f14006b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:18.647212 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cd54e5d8-5583-4d0d-bc74-d4c17f14006b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:18.647972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cd54e5d8-5583-4d0d-bc74-d4c17f14006b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:18.648557 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-cd54e5d8-5583-4d0d-bc74-d4c17f14006b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:18.814650 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-cd54e5d8-5583-4d0d-bc74-d4c17f14006b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:18.826848 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-cd54e5d8-5583-4d0d-bc74-d4c17f14006b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1708 microversion: 2.1 time: 0.192600 Jun 20 15:01:18.828362 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 440/863] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:18 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1708 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:19.850254 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e4fbb3c2-cc16-4ab5-bf5a-0cc8ea55b116 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:19.851416 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e4fbb3c2-cc16-4ab5-bf5a-0cc8ea55b116 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:19.858712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e4fbb3c2-cc16-4ab5-bf5a-0cc8ea55b116 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:19.859215 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e4fbb3c2-cc16-4ab5-bf5a-0cc8ea55b116 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:19.859951 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e4fbb3c2-cc16-4ab5-bf5a-0cc8ea55b116 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:19.860389 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e4fbb3c2-cc16-4ab5-bf5a-0cc8ea55b116 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:19.993442 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-e4fbb3c2-cc16-4ab5-bf5a-0cc8ea55b116 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:20.001881 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e4fbb3c2-cc16-4ab5-bf5a-0cc8ea55b116 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1708 microversion: 2.1 time: 0.159452 Jun 20 15:01:20.002437 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 424/864] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:19 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1708 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:21.023415 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7e3d55cc-5ebc-460e-90c1-f042fb96bfef tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:21.024489 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7e3d55cc-5ebc-460e-90c1-f042fb96bfef tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:21.031759 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7e3d55cc-5ebc-460e-90c1-f042fb96bfef tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:21.032209 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7e3d55cc-5ebc-460e-90c1-f042fb96bfef tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:21.033007 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7e3d55cc-5ebc-460e-90c1-f042fb96bfef tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:21.033430 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7e3d55cc-5ebc-460e-90c1-f042fb96bfef tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:21.169247 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7e3d55cc-5ebc-460e-90c1-f042fb96bfef tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:21.177496 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7e3d55cc-5ebc-460e-90c1-f042fb96bfef tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1708 microversion: 2.1 time: 0.160657 Jun 20 15:01:21.178063 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 441/865] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:21 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1708 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:22.198638 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f291030e-9f1c-495c-b391-6a2d1c0924c1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:22.199405 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f291030e-9f1c-495c-b391-6a2d1c0924c1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:22.208414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f291030e-9f1c-495c-b391-6a2d1c0924c1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:22.209075 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f291030e-9f1c-495c-b391-6a2d1c0924c1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:22.210085 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f291030e-9f1c-495c-b391-6a2d1c0924c1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:22.210659 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f291030e-9f1c-495c-b391-6a2d1c0924c1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:22.348680 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f291030e-9f1c-495c-b391-6a2d1c0924c1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:22.358081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f291030e-9f1c-495c-b391-6a2d1c0924c1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1708 microversion: 2.1 time: 0.165349 Jun 20 15:01:22.358718 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 425/866] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:22 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:23.379767 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-876d1308-95b7-4c7f-9165-dfa799603f1b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:23.380671 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-876d1308-95b7-4c7f-9165-dfa799603f1b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:23.392068 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-876d1308-95b7-4c7f-9165-dfa799603f1b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:23.392850 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-876d1308-95b7-4c7f-9165-dfa799603f1b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:23.394101 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-876d1308-95b7-4c7f-9165-dfa799603f1b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:23.394816 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-876d1308-95b7-4c7f-9165-dfa799603f1b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:23.528728 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-876d1308-95b7-4c7f-9165-dfa799603f1b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:23.531072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:01:23.538120 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-876d1308-95b7-4c7f-9165-dfa799603f1b tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1712 microversion: 2.1 time: 0.165114 Jun 20 15:01:23.538678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 442/867] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:23 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1712 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:25.347356 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2034498930", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2098402945", "security_groups": [{"name": "tempest-secgroup-smoke-1201977844"}], "block_device_mapping_v2": [{"uuid": "dce7fee5-3086-45f2-ab0d-965df8ac4aaf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7c7b0d7e-13ae-4804-adde-4f7659f4fca5"}]}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:01:25.467961 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.network.neutron [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] validate_networks() for [('7c7b0d7e-13ae-4804-adde-4f7659f4fca5', None, None, None, None, None)] {{(pid=123978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 15:01:25.846082 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Flavor limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 15:01:25.846643 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Image limits 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 15:01:25.847393 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Flavor pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 15:01:25.847839 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Image pref 0:0:0 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 15:01:25.848421 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.virt.hardware [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 15:01:25.859019 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:25.859836 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:25.861286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:25.861954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:25.887405 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Getting quotas for project c4515b09c1944036b62a40cc5e88719e. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 15:01:25.891505 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Getting quotas for user 3876008710b8469c9f65a24789a58067 and project c4515b09c1944036b62a40cc5e88719e. Resources: {'cores', 'instances', 'ram'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 15:01:25.948633 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Going to run 1 instances... {{(pid=123978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 15:01:25.950761 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dce7fee5-3086-45f2-ab0d-965df8ac4aaf',volume_size=None,volume_type=None)] {{(pid=123978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 15:01:26.090819 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-eb1c2fce-4618-4873-9c52-c4adeee8b5a7 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.749960 Jun 20 15:01:26.091483 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 426/868] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 15:01:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 15:01:26.101732 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-a7cc17d5-b08c-4362-827f-aacf7083be07 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:26.102283 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-a7cc17d5-b08c-4362-827f-aacf7083be07 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:26.105096 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=25 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:01:26.158194 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-a7cc17d5-b08c-4362-827f-aacf7083be07 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:26.165039 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-a7cc17d5-b08c-4362-827f-aacf7083be07 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1095 microversion: 2.1 time: 0.067126 Jun 20 15:01:26.166032 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 443/869] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:26 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:27.183278 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-402d10e7-ba8c-4010-9f62-f06dca0edc1a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:27.186695 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-402d10e7-ba8c-4010-9f62-f06dca0edc1a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:27.190994 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:01:27.197302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-402d10e7-ba8c-4010-9f62-f06dca0edc1a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:27.197843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-402d10e7-ba8c-4010-9f62-f06dca0edc1a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:27.198702 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-402d10e7-ba8c-4010-9f62-f06dca0edc1a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:27.199270 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-402d10e7-ba8c-4010-9f62-f06dca0edc1a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:27.205272 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:01:27.270830 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-402d10e7-ba8c-4010-9f62-f06dca0edc1a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:27.278679 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-402d10e7-ba8c-4010-9f62-f06dca0edc1a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1211 microversion: 2.1 time: 0.100420 Jun 20 15:01:27.279172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 427/870] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:27 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:28.295653 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b542815c-f6c2-432f-a7d1-815e81e6f144 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:28.296256 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-b542815c-f6c2-432f-a7d1-815e81e6f144 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:28.302972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b542815c-f6c2-432f-a7d1-815e81e6f144 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:28.303669 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b542815c-f6c2-432f-a7d1-815e81e6f144 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:28.304423 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b542815c-f6c2-432f-a7d1-815e81e6f144 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:28.304894 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b542815c-f6c2-432f-a7d1-815e81e6f144 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:28.448503 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-b542815c-f6c2-432f-a7d1-815e81e6f144 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:28.458027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-b542815c-f6c2-432f-a7d1-815e81e6f144 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1267 microversion: 2.1 time: 0.166174 Jun 20 15:01:28.458885 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 444/871] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:28 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:28.645709 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-7f757776-7cfc-4b7f-9ccc-7607241341ae req-1dcf569b-13f8-457c-bc6f-7a89e7d44efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "108600b1-78ac-473f-99ef-5f8440ac73c3", "tag": "e312c7fc-f965-4d38-9d7e-fe6001e96874"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:01:28.660338 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-7f757776-7cfc-4b7f-9ccc-7607241341ae req-1dcf569b-13f8-457c-bc6f-7a89e7d44efd service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:28.660811 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-7f757776-7cfc-4b7f-9ccc-7607241341ae req-1dcf569b-13f8-457c-bc6f-7a89e7d44efd service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:28.675200 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-7f757776-7cfc-4b7f-9ccc-7607241341ae req-1dcf569b-13f8-457c-bc6f-7a89e7d44efd service nova] Creating event network-changed:e312c7fc-f965-4d38-9d7e-fe6001e96874 for instance 108600b1-78ac-473f-99ef-5f8440ac73c3 on hv-cinder-83697 Jun 20 15:01:28.680900 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-7f757776-7cfc-4b7f-9ccc-7607241341ae req-1dcf569b-13f8-457c-bc6f-7a89e7d44efd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040967 Jun 20 15:01:28.681882 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 428/872] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:01:29.475768 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-75a95d7a-82ae-42ae-b278-e4142cfd6e2b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:29.476417 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-75a95d7a-82ae-42ae-b278-e4142cfd6e2b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:29.485861 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-75a95d7a-82ae-42ae-b278-e4142cfd6e2b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:29.486495 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-75a95d7a-82ae-42ae-b278-e4142cfd6e2b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:29.487258 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-75a95d7a-82ae-42ae-b278-e4142cfd6e2b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:29.487682 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-75a95d7a-82ae-42ae-b278-e4142cfd6e2b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:29.880233 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-75a95d7a-82ae-42ae-b278-e4142cfd6e2b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:29.887938 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-75a95d7a-82ae-42ae-b278-e4142cfd6e2b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1267 microversion: 2.1 time: 0.416209 Jun 20 15:01:29.888478 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 445/873] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:29 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1267 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:30.909543 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-79975208-3dd1-4385-bce7-a288574b5636 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:30.910545 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-79975208-3dd1-4385-bce7-a288574b5636 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:30.921774 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-79975208-3dd1-4385-bce7-a288574b5636 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:30.922517 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-79975208-3dd1-4385-bce7-a288574b5636 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:30.923785 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-79975208-3dd1-4385-bce7-a288574b5636 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:30.924492 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-79975208-3dd1-4385-bce7-a288574b5636 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:31.060443 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-79975208-3dd1-4385-bce7-a288574b5636 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:31.068287 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-79975208-3dd1-4385-bce7-a288574b5636 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1267 microversion: 2.1 time: 0.166234 Jun 20 15:01:31.068888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 429/874] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:30 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:32.089024 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7a2be073-4881-4dca-b11c-63c3a567da53 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:32.090016 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7a2be073-4881-4dca-b11c-63c3a567da53 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:32.101050 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7a2be073-4881-4dca-b11c-63c3a567da53 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:32.101793 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7a2be073-4881-4dca-b11c-63c3a567da53 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:32.103035 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7a2be073-4881-4dca-b11c-63c3a567da53 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:32.103746 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7a2be073-4881-4dca-b11c-63c3a567da53 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:32.247760 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-7a2be073-4881-4dca-b11c-63c3a567da53 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:32.255403 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7a2be073-4881-4dca-b11c-63c3a567da53 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1267 microversion: 2.1 time: 0.172787 Jun 20 15:01:32.256208 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 446/875] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:32 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:33.275844 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-5f5ae656-3820-478e-aaad-ed4f067f9592 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:33.276963 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-5f5ae656-3820-478e-aaad-ed4f067f9592 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:33.288028 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5f5ae656-3820-478e-aaad-ed4f067f9592 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:33.288669 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5f5ae656-3820-478e-aaad-ed4f067f9592 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:33.289983 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5f5ae656-3820-478e-aaad-ed4f067f9592 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:33.290704 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-5f5ae656-3820-478e-aaad-ed4f067f9592 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:33.429224 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-5f5ae656-3820-478e-aaad-ed4f067f9592 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:33.440562 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-5f5ae656-3820-478e-aaad-ed4f067f9592 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1267 microversion: 2.1 time: 0.171067 Jun 20 15:01:33.441389 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 430/876] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:33 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:34.458400 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d4ca5f26-92ee-4175-8057-f6502b9c571f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:34.459028 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d4ca5f26-92ee-4175-8057-f6502b9c571f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:34.466424 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d4ca5f26-92ee-4175-8057-f6502b9c571f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:34.466882 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d4ca5f26-92ee-4175-8057-f6502b9c571f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:34.467632 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d4ca5f26-92ee-4175-8057-f6502b9c571f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:34.468058 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d4ca5f26-92ee-4175-8057-f6502b9c571f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:34.603507 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d4ca5f26-92ee-4175-8057-f6502b9c571f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:34.614425 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d4ca5f26-92ee-4175-8057-f6502b9c571f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1267 microversion: 2.1 time: 0.159793 Jun 20 15:01:34.615193 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 447/877] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:34 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:35.631804 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f13b2119-2372-416c-b3de-f3b4af0cb718 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:35.632402 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f13b2119-2372-416c-b3de-f3b4af0cb718 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:35.639382 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f13b2119-2372-416c-b3de-f3b4af0cb718 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:35.639862 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f13b2119-2372-416c-b3de-f3b4af0cb718 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:35.640690 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f13b2119-2372-416c-b3de-f3b4af0cb718 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:35.641173 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f13b2119-2372-416c-b3de-f3b4af0cb718 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:35.789981 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f13b2119-2372-416c-b3de-f3b4af0cb718 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:35.798024 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f13b2119-2372-416c-b3de-f3b4af0cb718 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1267 microversion: 2.1 time: 0.170229 Jun 20 15:01:35.798613 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 431/878] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:35 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:36.819547 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d71c5150-472d-4fa3-9afb-d383f2e1187f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:36.820565 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d71c5150-472d-4fa3-9afb-d383f2e1187f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:36.824376 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:01:36.833937 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d71c5150-472d-4fa3-9afb-d383f2e1187f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:36.834690 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d71c5150-472d-4fa3-9afb-d383f2e1187f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:36.835960 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d71c5150-472d-4fa3-9afb-d383f2e1187f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:36.836687 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d71c5150-472d-4fa3-9afb-d383f2e1187f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:36.976640 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d71c5150-472d-4fa3-9afb-d383f2e1187f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:36.984523 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d71c5150-472d-4fa3-9afb-d383f2e1187f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1267 microversion: 2.1 time: 0.171820 Jun 20 15:01:36.985126 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 448/879] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:36 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:38.004401 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-461a97bf-e756-43f9-8139-5a4990aca9d8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:38.005225 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-461a97bf-e756-43f9-8139-5a4990aca9d8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:38.008018 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:01:38.008948 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=6 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:01:38.015579 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-461a97bf-e756-43f9-8139-5a4990aca9d8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:38.016077 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-461a97bf-e756-43f9-8139-5a4990aca9d8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:38.016980 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-461a97bf-e756-43f9-8139-5a4990aca9d8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:38.017489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-461a97bf-e756-43f9-8139-5a4990aca9d8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:38.151888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-461a97bf-e756-43f9-8139-5a4990aca9d8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:38.160068 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-461a97bf-e756-43f9-8139-5a4990aca9d8 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1267 microversion: 2.1 time: 0.162253 Jun 20 15:01:38.170165 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 432/880] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:37 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:39.181948 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-df7ae2bd-41f2-4041-bd5f-880e949093f3 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:39.183013 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-df7ae2bd-41f2-4041-bd5f-880e949093f3 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:39.190479 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-df7ae2bd-41f2-4041-bd5f-880e949093f3 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:39.190920 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-df7ae2bd-41f2-4041-bd5f-880e949093f3 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:39.191674 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-df7ae2bd-41f2-4041-bd5f-880e949093f3 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:39.192100 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-df7ae2bd-41f2-4041-bd5f-880e949093f3 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:39.325413 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-df7ae2bd-41f2-4041-bd5f-880e949093f3 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:39.333289 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-df7ae2bd-41f2-4041-bd5f-880e949093f3 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1267 microversion: 2.1 time: 0.157808 Jun 20 15:01:39.333892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 449/881] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:39 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:40.291349 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-c4d5ae2f-23de-447b-ad58-19b974cb6b80 req-e431e8b4-d5a6-4d50-b844-b3d0fde28379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "108600b1-78ac-473f-99ef-5f8440ac73c3", "name": "network-vif-plugged", "status": "completed", "tag": "e312c7fc-f965-4d38-9d7e-fe6001e96874"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:01:40.300227 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-c4d5ae2f-23de-447b-ad58-19b974cb6b80 req-e431e8b4-d5a6-4d50-b844-b3d0fde28379 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:40.300615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-c4d5ae2f-23de-447b-ad58-19b974cb6b80 req-e431e8b4-d5a6-4d50-b844-b3d0fde28379 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:40.315008 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-c4d5ae2f-23de-447b-ad58-19b974cb6b80 req-e431e8b4-d5a6-4d50-b844-b3d0fde28379 service nova] Creating event network-vif-plugged:e312c7fc-f965-4d38-9d7e-fe6001e96874 for instance 108600b1-78ac-473f-99ef-5f8440ac73c3 on hv-cinder-83697 Jun 20 15:01:40.320226 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-c4d5ae2f-23de-447b-ad58-19b974cb6b80 req-e431e8b4-d5a6-4d50-b844-b3d0fde28379 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032729 Jun 20 15:01:40.320859 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 433/882] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:01:40.356416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b18665cf-b871-429d-ad0a-587aaad3b10a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:40.357718 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-b18665cf-b871-429d-ad0a-587aaad3b10a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:40.364477 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b18665cf-b871-429d-ad0a-587aaad3b10a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:40.364956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b18665cf-b871-429d-ad0a-587aaad3b10a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:40.365697 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b18665cf-b871-429d-ad0a-587aaad3b10a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:40.366326 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b18665cf-b871-429d-ad0a-587aaad3b10a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:40.506073 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-b18665cf-b871-429d-ad0a-587aaad3b10a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:40.514401 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-b18665cf-b871-429d-ad0a-587aaad3b10a tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1267 microversion: 2.1 time: 0.162700 Jun 20 15:01:40.515150 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 450/883] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:40 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:41.535751 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-25f341cc-f491-4e09-8099-61043d8e0f6f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:41.536450 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-25f341cc-f491-4e09-8099-61043d8e0f6f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:41.543643 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-25f341cc-f491-4e09-8099-61043d8e0f6f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:41.544088 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-25f341cc-f491-4e09-8099-61043d8e0f6f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:41.544880 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-25f341cc-f491-4e09-8099-61043d8e0f6f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:41.545312 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-25f341cc-f491-4e09-8099-61043d8e0f6f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:41.696524 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-25f341cc-f491-4e09-8099-61043d8e0f6f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:41.705847 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-25f341cc-f491-4e09-8099-61043d8e0f6f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1267 microversion: 2.1 time: 0.174758 Jun 20 15:01:41.706423 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 434/884] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:41 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:42.727589 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-4981c6e4-9b92-4155-b015-89007213408e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:42.728520 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-4981c6e4-9b92-4155-b015-89007213408e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:42.740495 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4981c6e4-9b92-4155-b015-89007213408e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:42.741302 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4981c6e4-9b92-4155-b015-89007213408e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:42.742562 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4981c6e4-9b92-4155-b015-89007213408e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:42.743296 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4981c6e4-9b92-4155-b015-89007213408e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:42.894909 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-4981c6e4-9b92-4155-b015-89007213408e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:42.902776 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-4981c6e4-9b92-4155-b015-89007213408e tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1454 microversion: 2.1 time: 0.181658 Jun 20 15:01:42.903368 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 451/885] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:42 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1454 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:42.919169 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ae4a3f33-c132-4780-bac2-ec706d4a3578 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:42.919777 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ae4a3f33-c132-4780-bac2-ec706d4a3578 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:42.926707 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ae4a3f33-c132-4780-bac2-ec706d4a3578 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:42.927163 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ae4a3f33-c132-4780-bac2-ec706d4a3578 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:42.927953 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ae4a3f33-c132-4780-bac2-ec706d4a3578 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:42.928396 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ae4a3f33-c132-4780-bac2-ec706d4a3578 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:43.068754 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ae4a3f33-c132-4780-bac2-ec706d4a3578 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:43.076533 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ae4a3f33-c132-4780-bac2-ec706d4a3578 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1454 microversion: 2.1 time: 0.161471 Jun 20 15:01:43.077140 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 435/886] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:42 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:44.747220 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-5cd00886-cd29-4c3f-948c-f0adb182a8b6 req-b6b057ed-cbec-480e-82c8-7474994d7918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "108600b1-78ac-473f-99ef-5f8440ac73c3", "tag": "e312c7fc-f965-4d38-9d7e-fe6001e96874"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:01:44.755911 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-5cd00886-cd29-4c3f-948c-f0adb182a8b6 req-b6b057ed-cbec-480e-82c8-7474994d7918 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:44.756428 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-5cd00886-cd29-4c3f-948c-f0adb182a8b6 req-b6b057ed-cbec-480e-82c8-7474994d7918 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:44.769372 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-5cd00886-cd29-4c3f-948c-f0adb182a8b6 req-b6b057ed-cbec-480e-82c8-7474994d7918 service nova] Creating event network-changed:e312c7fc-f965-4d38-9d7e-fe6001e96874 for instance 108600b1-78ac-473f-99ef-5f8440ac73c3 on hv-cinder-83697 Jun 20 15:01:44.774525 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-5cd00886-cd29-4c3f-948c-f0adb182a8b6 req-b6b057ed-cbec-480e-82c8-7474994d7918 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031065 Jun 20 15:01:44.775148 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 452/887] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:01:56.309912 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-fbab1f01-1b6b-498c-a18c-a3ec0b1720d9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:56.310771 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-fbab1f01-1b6b-498c-a18c-a3ec0b1720d9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:56.313422 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=17 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:01:56.314065 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=45 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:01:56.320854 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fbab1f01-1b6b-498c-a18c-a3ec0b1720d9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:56.321299 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fbab1f01-1b6b-498c-a18c-a3ec0b1720d9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:56.322060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fbab1f01-1b6b-498c-a18c-a3ec0b1720d9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:56.322493 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fbab1f01-1b6b-498c-a18c-a3ec0b1720d9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:56.405945 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-fbab1f01-1b6b-498c-a18c-a3ec0b1720d9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lazy-loading 'services' on Instance uuid 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 15:01:56.485161 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-fbab1f01-1b6b-498c-a18c-a3ec0b1720d9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/os-volume_attachments/d5979d31-7de3-4153-807d-86996fc760e2" status: 202 len: 0 microversion: 2.1 time: 0.181692 Jun 20 15:01:56.485749 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 436/888] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 15:01:56 2022] DELETE /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/os-volume_attachments/d5979d31-7de3-4153-807d-86996fc760e2 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 15:01:57.602897 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=21 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:01:57.603725 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=51 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:01:57.608377 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-19752a25-17c1-4227-bd42-2445bde7c716 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:01:57.615577 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-19752a25-17c1-4227-bd42-2445bde7c716 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:57.616023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-19752a25-17c1-4227-bd42-2445bde7c716 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:57.637396 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-19752a25-17c1-4227-bd42-2445bde7c716 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Going to try to stop instance {{(pid=123979) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 15:01:57.688638 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-19752a25-17c1-4227-bd42-2445bde7c716 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "POST /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/action" status: 202 len: 0 microversion: 2.1 time: 0.087090 Jun 20 15:01:57.689265 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 453/889] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 15:01:57 2022] POST /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 15:01:57.699428 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e9936961-3f65-46cf-a872-15e93aceb90f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:57.700663 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e9936961-3f65-46cf-a872-15e93aceb90f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:57.710325 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e9936961-3f65-46cf-a872-15e93aceb90f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:57.710830 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e9936961-3f65-46cf-a872-15e93aceb90f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:57.711678 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e9936961-3f65-46cf-a872-15e93aceb90f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:57.712104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e9936961-3f65-46cf-a872-15e93aceb90f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:57.852315 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-e9936961-3f65-46cf-a872-15e93aceb90f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:57.865469 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e9936961-3f65-46cf-a872-15e93aceb90f tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1676 microversion: 2.1 time: 0.171293 Jun 20 15:01:57.866677 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 437/890] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:57 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:01:58.889818 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-975ac157-7177-473d-9894-3276f0430a60 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:01:58.891005 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-975ac157-7177-473d-9894-3276f0430a60 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:01:58.898481 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-975ac157-7177-473d-9894-3276f0430a60 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:58.898929 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-975ac157-7177-473d-9894-3276f0430a60 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:58.899683 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-975ac157-7177-473d-9894-3276f0430a60 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:01:58.900113 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-975ac157-7177-473d-9894-3276f0430a60 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:01:59.046199 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-975ac157-7177-473d-9894-3276f0430a60 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:01:59.054015 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-975ac157-7177-473d-9894-3276f0430a60 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1676 microversion: 2.1 time: 0.172164 Jun 20 15:01:59.054583 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 454/891] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:01:58 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:00.073025 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-8c9279c0-0672-4747-8c08-4f30eeee346a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:00.073706 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-8c9279c0-0672-4747-8c08-4f30eeee346a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:00.081332 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8c9279c0-0672-4747-8c08-4f30eeee346a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:00.081769 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8c9279c0-0672-4747-8c08-4f30eeee346a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:00.082521 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8c9279c0-0672-4747-8c08-4f30eeee346a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:00.082952 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8c9279c0-0672-4747-8c08-4f30eeee346a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:00.215893 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-8c9279c0-0672-4747-8c08-4f30eeee346a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:00.226450 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-8c9279c0-0672-4747-8c08-4f30eeee346a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1676 microversion: 2.1 time: 0.157569 Jun 20 15:02:00.227282 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 438/892] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:00 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:01.253800 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-89496542-ce93-4e2d-8ecf-dd51ba61b8bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:01.254733 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-89496542-ce93-4e2d-8ecf-dd51ba61b8bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:01.265445 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-89496542-ce93-4e2d-8ecf-dd51ba61b8bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:01.266197 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-89496542-ce93-4e2d-8ecf-dd51ba61b8bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:01.267460 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-89496542-ce93-4e2d-8ecf-dd51ba61b8bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:01.267987 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-89496542-ce93-4e2d-8ecf-dd51ba61b8bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:01.415999 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-89496542-ce93-4e2d-8ecf-dd51ba61b8bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:01.426184 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-89496542-ce93-4e2d-8ecf-dd51ba61b8bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1676 microversion: 2.1 time: 0.178869 Jun 20 15:02:01.426758 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 455/893] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:01 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:02.446043 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-737d199a-9a1c-4508-ba85-922b31da3127 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:02.446752 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-737d199a-9a1c-4508-ba85-922b31da3127 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:02.455062 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-737d199a-9a1c-4508-ba85-922b31da3127 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:02.455586 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-737d199a-9a1c-4508-ba85-922b31da3127 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:02.456483 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-737d199a-9a1c-4508-ba85-922b31da3127 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:02.457035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-737d199a-9a1c-4508-ba85-922b31da3127 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:02.597634 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-737d199a-9a1c-4508-ba85-922b31da3127 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:02.609547 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-737d199a-9a1c-4508-ba85-922b31da3127 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1676 microversion: 2.1 time: 0.167906 Jun 20 15:02:02.610327 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 439/894] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:02 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:03.628775 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-c59474bb-747a-4879-8e6c-3a8111472755 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:03.629518 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-c59474bb-747a-4879-8e6c-3a8111472755 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:03.637112 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c59474bb-747a-4879-8e6c-3a8111472755 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:03.637561 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c59474bb-747a-4879-8e6c-3a8111472755 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:03.638323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c59474bb-747a-4879-8e6c-3a8111472755 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:03.638739 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c59474bb-747a-4879-8e6c-3a8111472755 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:03.831613 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-c59474bb-747a-4879-8e6c-3a8111472755 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:03.839877 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-c59474bb-747a-4879-8e6c-3a8111472755 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1676 microversion: 2.1 time: 0.215008 Jun 20 15:02:03.840434 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 456/895] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:03 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1676 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:04.862084 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ec243914-bd6b-47de-b83e-97fa0e3b4b05 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:04.863237 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ec243914-bd6b-47de-b83e-97fa0e3b4b05 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:04.873107 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ec243914-bd6b-47de-b83e-97fa0e3b4b05 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:04.873571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ec243914-bd6b-47de-b83e-97fa0e3b4b05 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:04.874884 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ec243914-bd6b-47de-b83e-97fa0e3b4b05 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:04.875503 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ec243914-bd6b-47de-b83e-97fa0e3b4b05 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:05.080925 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ec243914-bd6b-47de-b83e-97fa0e3b4b05 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:05.089003 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ec243914-bd6b-47de-b83e-97fa0e3b4b05 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1676 microversion: 2.1 time: 0.234925 Jun 20 15:02:05.089622 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 440/896] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:04 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1676 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:06.111405 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8bc9b998-fbcd-4a15-82ba-352cfedc98cb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:06.112397 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-8bc9b998-fbcd-4a15-82ba-352cfedc98cb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:06.124596 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8bc9b998-fbcd-4a15-82ba-352cfedc98cb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:06.125413 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8bc9b998-fbcd-4a15-82ba-352cfedc98cb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:06.126705 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8bc9b998-fbcd-4a15-82ba-352cfedc98cb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:06.127434 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8bc9b998-fbcd-4a15-82ba-352cfedc98cb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:06.277952 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8bc9b998-fbcd-4a15-82ba-352cfedc98cb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:06.290188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-8bc9b998-fbcd-4a15-82ba-352cfedc98cb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1676 microversion: 2.1 time: 0.185496 Jun 20 15:02:06.290847 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 457/897] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:06 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:07.316677 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-43906931-892b-45fa-96d8-c859626d70e1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:07.317669 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-43906931-892b-45fa-96d8-c859626d70e1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:07.329395 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-43906931-892b-45fa-96d8-c859626d70e1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:07.330114 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-43906931-892b-45fa-96d8-c859626d70e1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:07.331302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-43906931-892b-45fa-96d8-c859626d70e1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:07.331966 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-43906931-892b-45fa-96d8-c859626d70e1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:07.475309 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-43906931-892b-45fa-96d8-c859626d70e1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:07.484158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-43906931-892b-45fa-96d8-c859626d70e1 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1676 microversion: 2.1 time: 0.173704 Jun 20 15:02:07.484753 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 441/898] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:07 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:08.512428 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-067f18a2-c1c3-4324-8a27-d2849415b5ca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:08.513063 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-067f18a2-c1c3-4324-8a27-d2849415b5ca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:08.520188 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-067f18a2-c1c3-4324-8a27-d2849415b5ca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:08.520626 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-067f18a2-c1c3-4324-8a27-d2849415b5ca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:08.521411 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-067f18a2-c1c3-4324-8a27-d2849415b5ca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:08.521832 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-067f18a2-c1c3-4324-8a27-d2849415b5ca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:08.656906 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-067f18a2-c1c3-4324-8a27-d2849415b5ca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:08.668364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-067f18a2-c1c3-4324-8a27-d2849415b5ca tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1653 microversion: 2.1 time: 0.162199 Jun 20 15:02:08.669140 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 458/899] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:08 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1653 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:08.686258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-a5e24c79-c8bb-4c0b-a1d5-763e1559c994 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:02:08.693290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a5e24c79-c8bb-4c0b-a1d5-763e1559c994 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:08.693731 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a5e24c79-c8bb-4c0b-a1d5-763e1559c994 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:08.716953 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-a5e24c79-c8bb-4c0b-a1d5-763e1559c994 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Going to try to start instance {{(pid=123978) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 15:02:08.773987 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-a5e24c79-c8bb-4c0b-a1d5-763e1559c994 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "POST /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/action" status: 202 len: 0 microversion: 2.1 time: 0.091691 Jun 20 15:02:08.774714 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 442/900] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 15:02:08 2022] POST /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 15:02:08.783327 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b1764c15-d0df-43f9-a3f3-d6814b132464 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:08.784446 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-b1764c15-d0df-43f9-a3f3-d6814b132464 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:08.792582 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b1764c15-d0df-43f9-a3f3-d6814b132464 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:08.793078 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b1764c15-d0df-43f9-a3f3-d6814b132464 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:08.793916 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b1764c15-d0df-43f9-a3f3-d6814b132464 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:08.794369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b1764c15-d0df-43f9-a3f3-d6814b132464 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:08.934022 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-b1764c15-d0df-43f9-a3f3-d6814b132464 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:08.942971 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-b1764c15-d0df-43f9-a3f3-d6814b132464 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1662 microversion: 2.1 time: 0.163756 Jun 20 15:02:08.943541 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 459/901] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:08 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1662 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:09.963311 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-57603503-fc38-47c0-9f5f-1482e0edd30c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:09.964120 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-57603503-fc38-47c0-9f5f-1482e0edd30c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:09.972592 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-57603503-fc38-47c0-9f5f-1482e0edd30c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:09.973152 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-57603503-fc38-47c0-9f5f-1482e0edd30c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:09.974059 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-57603503-fc38-47c0-9f5f-1482e0edd30c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:09.974567 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-57603503-fc38-47c0-9f5f-1482e0edd30c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:10.134652 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-57603503-fc38-47c0-9f5f-1482e0edd30c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:10.142418 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-57603503-fc38-47c0-9f5f-1482e0edd30c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1662 microversion: 2.1 time: 0.184214 Jun 20 15:02:10.142983 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 443/902] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:09 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1662 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:11.160046 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8eb52202-a63c-43e3-918e-f82de678b2ed tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:11.160647 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-8eb52202-a63c-43e3-918e-f82de678b2ed tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:11.167783 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8eb52202-a63c-43e3-918e-f82de678b2ed tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:11.168207 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8eb52202-a63c-43e3-918e-f82de678b2ed tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:11.169020 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8eb52202-a63c-43e3-918e-f82de678b2ed tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:11.169440 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8eb52202-a63c-43e3-918e-f82de678b2ed tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:11.313169 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8eb52202-a63c-43e3-918e-f82de678b2ed tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:11.320745 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-8eb52202-a63c-43e3-918e-f82de678b2ed tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1666 microversion: 2.1 time: 0.164603 Jun 20 15:02:11.321322 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 460/903] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:11 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:12.069022 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 15:02:12.069523 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Mon Jun 20 15:02:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 15:02:20.317572 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 15:02:20.318159 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Mon Jun 20 15:02:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 15:02:29.219484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 15:02:29.220518 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Mon Jun 20 15:02:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 15:02:37.258693 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-08c0e351-28b2-44f4-9f1c-cbcd8b317166 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:02:37.259685 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-08c0e351-28b2-44f4-9f1c-cbcd8b317166 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:37.262891 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=16 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:02:37.263955 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:02:37.273363 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-08c0e351-28b2-44f4-9f1c-cbcd8b317166 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:37.273824 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-08c0e351-28b2-44f4-9f1c-cbcd8b317166 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:37.274594 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-08c0e351-28b2-44f4-9f1c-cbcd8b317166 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:37.275028 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-08c0e351-28b2-44f4-9f1c-cbcd8b317166 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:37.298902 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-08c0e351-28b2-44f4-9f1c-cbcd8b317166 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lazy-loading 'flavor' on Instance uuid 69f9ab17-ba92-425c-b79e-ace0b9666352 {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 15:02:37.384292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-08c0e351-28b2-44f4-9f1c-cbcd8b317166 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "POST /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352/action" status: 202 len: 0 microversion: 2.1 time: 0.132387 Jun 20 15:02:37.385182 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 444/904] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 15:02:37 2022] POST /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 15:02:37.393620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-27d3340a-8a21-401e-ae73-143b430acea8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:37.395608 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-27d3340a-8a21-401e-ae73-143b430acea8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:37.401637 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=16 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:02:37.402542 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:02:37.407966 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-27d3340a-8a21-401e-ae73-143b430acea8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:37.408545 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-27d3340a-8a21-401e-ae73-143b430acea8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:37.410112 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-27d3340a-8a21-401e-ae73-143b430acea8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:37.410629 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-27d3340a-8a21-401e-ae73-143b430acea8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:37.561394 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-27d3340a-8a21-401e-ae73-143b430acea8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:37.569389 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-27d3340a-8a21-401e-ae73-143b430acea8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1570 microversion: 2.1 time: 0.179724 Jun 20 15:02:37.569952 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 461/905] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:37 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:38.593213 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-300a7f00-f2bb-4e78-b34a-811864eb2f1a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:38.594230 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-300a7f00-f2bb-4e78-b34a-811864eb2f1a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:38.602493 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-300a7f00-f2bb-4e78-b34a-811864eb2f1a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:38.602933 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-300a7f00-f2bb-4e78-b34a-811864eb2f1a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:38.603707 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-300a7f00-f2bb-4e78-b34a-811864eb2f1a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:38.604140 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-300a7f00-f2bb-4e78-b34a-811864eb2f1a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:38.756106 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-300a7f00-f2bb-4e78-b34a-811864eb2f1a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:38.767906 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-300a7f00-f2bb-4e78-b34a-811864eb2f1a tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1570 microversion: 2.1 time: 0.183492 Jun 20 15:02:38.768835 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 445/906] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:38 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:39.790317 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e6e694e5-501e-49c8-83ed-0d7fe98dded0 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:39.791256 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e6e694e5-501e-49c8-83ed-0d7fe98dded0 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:39.802597 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e6e694e5-501e-49c8-83ed-0d7fe98dded0 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:39.803496 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e6e694e5-501e-49c8-83ed-0d7fe98dded0 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:39.804579 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e6e694e5-501e-49c8-83ed-0d7fe98dded0 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:39.805331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e6e694e5-501e-49c8-83ed-0d7fe98dded0 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:39.947570 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e6e694e5-501e-49c8-83ed-0d7fe98dded0 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:39.955874 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e6e694e5-501e-49c8-83ed-0d7fe98dded0 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1570 microversion: 2.1 time: 0.172442 Jun 20 15:02:39.956435 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 462/907] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:39 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:40.975788 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-16ddb775-631a-4660-bfcc-ba0d87047bd9 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:40.976600 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-16ddb775-631a-4660-bfcc-ba0d87047bd9 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:40.986993 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-16ddb775-631a-4660-bfcc-ba0d87047bd9 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:40.987638 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-16ddb775-631a-4660-bfcc-ba0d87047bd9 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:40.988449 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-16ddb775-631a-4660-bfcc-ba0d87047bd9 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:40.988920 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-16ddb775-631a-4660-bfcc-ba0d87047bd9 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:41.139775 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-16ddb775-631a-4660-bfcc-ba0d87047bd9 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:41.147658 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-16ddb775-631a-4660-bfcc-ba0d87047bd9 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1570 microversion: 2.1 time: 0.178026 Jun 20 15:02:41.148227 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 446/908] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:40 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:42.174439 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d3e72e89-08bc-49ba-a747-57cc472a0a5d tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:42.175522 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d3e72e89-08bc-49ba-a747-57cc472a0a5d tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:42.187261 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d3e72e89-08bc-49ba-a747-57cc472a0a5d tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:42.187995 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d3e72e89-08bc-49ba-a747-57cc472a0a5d tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:42.189416 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d3e72e89-08bc-49ba-a747-57cc472a0a5d tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:42.190132 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d3e72e89-08bc-49ba-a747-57cc472a0a5d tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:42.339310 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d3e72e89-08bc-49ba-a747-57cc472a0a5d tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:42.348081 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d3e72e89-08bc-49ba-a747-57cc472a0a5d tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1570 microversion: 2.1 time: 0.180151 Jun 20 15:02:42.348657 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 463/909] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:42 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:43.365870 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0a9bbac1-ec2d-4893-ba49-7053878079c5 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:43.366425 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-0a9bbac1-ec2d-4893-ba49-7053878079c5 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:43.374801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0a9bbac1-ec2d-4893-ba49-7053878079c5 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:43.375253 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0a9bbac1-ec2d-4893-ba49-7053878079c5 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:43.376038 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0a9bbac1-ec2d-4893-ba49-7053878079c5 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:43.376456 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0a9bbac1-ec2d-4893-ba49-7053878079c5 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:43.526177 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0a9bbac1-ec2d-4893-ba49-7053878079c5 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:43.537097 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0a9bbac1-ec2d-4893-ba49-7053878079c5 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1570 microversion: 2.1 time: 0.175390 Jun 20 15:02:43.537645 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 447/910] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:43 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:43.617038 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-54149438-df94-4955-a26c-5f6d40c306a0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:43.617972 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-54149438-df94-4955-a26c-5f6d40c306a0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:43.624698 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-54149438-df94-4955-a26c-5f6d40c306a0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:43.625178 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-54149438-df94-4955-a26c-5f6d40c306a0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:43.625931 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-54149438-df94-4955-a26c-5f6d40c306a0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:43.626363 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-54149438-df94-4955-a26c-5f6d40c306a0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:43.658678 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-54149438-df94-4955-a26c-5f6d40c306a0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045677 Jun 20 15:02:43.659228 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 464/911] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 15:02:43 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 15:02:43.720648 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-cc2676cc-f7ef-48d6-b2df-31ea0ca489aa tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:43.721160 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-cc2676cc-f7ef-48d6-b2df-31ea0ca489aa tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:43.727513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cc2676cc-f7ef-48d6-b2df-31ea0ca489aa tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:43.727976 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cc2676cc-f7ef-48d6-b2df-31ea0ca489aa tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:43.728735 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cc2676cc-f7ef-48d6-b2df-31ea0ca489aa tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:43.729176 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-cc2676cc-f7ef-48d6-b2df-31ea0ca489aa tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:43.753721 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-cc2676cc-f7ef-48d6-b2df-31ea0ca489aa tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 15:02:43.837313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-cc2676cc-f7ef-48d6-b2df-31ea0ca489aa tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 204 len: 0 microversion: 2.1 time: 0.120176 Jun 20 15:02:43.837917 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 448/912] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 15:02:43 2022] DELETE /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 15:02:43.847067 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8d282a96-b4e2-4cf2-84f5-ed3019252056 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:43.847935 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-8d282a96-b4e2-4cf2-84f5-ed3019252056 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:43.854241 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8d282a96-b4e2-4cf2-84f5-ed3019252056 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:43.854684 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8d282a96-b4e2-4cf2-84f5-ed3019252056 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:43.855442 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8d282a96-b4e2-4cf2-84f5-ed3019252056 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:43.855867 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8d282a96-b4e2-4cf2-84f5-ed3019252056 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:43.996200 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8d282a96-b4e2-4cf2-84f5-ed3019252056 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:44.007522 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-8d282a96-b4e2-4cf2-84f5-ed3019252056 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1672 microversion: 2.1 time: 0.164171 Jun 20 15:02:44.008336 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 465/913] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:43 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:44.560831 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-17c64a08-7e81-4a4c-8b81-6881bcf47f9c tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:44.561904 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-17c64a08-7e81-4a4c-8b81-6881bcf47f9c tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:44.570695 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-17c64a08-7e81-4a4c-8b81-6881bcf47f9c tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:44.571150 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-17c64a08-7e81-4a4c-8b81-6881bcf47f9c tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:44.571918 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-17c64a08-7e81-4a4c-8b81-6881bcf47f9c tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:44.572351 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-17c64a08-7e81-4a4c-8b81-6881bcf47f9c tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:44.714757 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-17c64a08-7e81-4a4c-8b81-6881bcf47f9c tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:44.727206 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-17c64a08-7e81-4a4c-8b81-6881bcf47f9c tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1570 microversion: 2.1 time: 0.174074 Jun 20 15:02:44.727989 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 449/914] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:44 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:45.032379 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-102f8717-0eee-4185-990b-cf800854b076 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:45.033486 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-102f8717-0eee-4185-990b-cf800854b076 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:45.041345 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-102f8717-0eee-4185-990b-cf800854b076 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:45.041788 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-102f8717-0eee-4185-990b-cf800854b076 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:45.042553 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-102f8717-0eee-4185-990b-cf800854b076 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:45.042989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-102f8717-0eee-4185-990b-cf800854b076 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:45.187744 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-102f8717-0eee-4185-990b-cf800854b076 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:45.196125 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-102f8717-0eee-4185-990b-cf800854b076 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1672 microversion: 2.1 time: 0.170388 Jun 20 15:02:45.196704 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 466/915] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:45 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:45.749756 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-73ea775c-1473-491b-ab63-1559c960fd90 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:45.750380 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-73ea775c-1473-491b-ab63-1559c960fd90 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:45.758013 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-73ea775c-1473-491b-ab63-1559c960fd90 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:45.758385 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-73ea775c-1473-491b-ab63-1559c960fd90 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:45.759173 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-73ea775c-1473-491b-ab63-1559c960fd90 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:45.759600 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-73ea775c-1473-491b-ab63-1559c960fd90 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:45.969773 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-73ea775c-1473-491b-ab63-1559c960fd90 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:45.977812 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-73ea775c-1473-491b-ab63-1559c960fd90 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1570 microversion: 2.1 time: 0.232161 Jun 20 15:02:45.978386 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 450/916] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:45 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1570 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:46.214063 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-805f5642-55d1-4758-af10-0987311feacb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:46.214644 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-805f5642-55d1-4758-af10-0987311feacb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:46.221473 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-805f5642-55d1-4758-af10-0987311feacb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:46.221920 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-805f5642-55d1-4758-af10-0987311feacb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:46.222672 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-805f5642-55d1-4758-af10-0987311feacb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:46.223151 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-805f5642-55d1-4758-af10-0987311feacb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:46.358690 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-805f5642-55d1-4758-af10-0987311feacb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:46.366789 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-805f5642-55d1-4758-af10-0987311feacb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 200 len: 1672 microversion: 2.1 time: 0.156694 Jun 20 15:02:46.376436 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 467/917] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:46 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:46.640937 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-2a9e5adb-7b8f-4bac-941d-ae7b674c7ce6 req-0024386d-5cbd-4c71-8459-d5fa35c6a243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d7eb8d0-d6c0-4416-9d51-b8e7c732800e", "name": "network-vif-deleted", "tag": "a3b20ac7-62d6-43cf-93f6-146ca5fdecbe"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:02:46.650310 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-2a9e5adb-7b8f-4bac-941d-ae7b674c7ce6 req-0024386d-5cbd-4c71-8459-d5fa35c6a243 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:46.650745 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-2a9e5adb-7b8f-4bac-941d-ae7b674c7ce6 req-0024386d-5cbd-4c71-8459-d5fa35c6a243 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:46.663386 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-2a9e5adb-7b8f-4bac-941d-ae7b674c7ce6 req-0024386d-5cbd-4c71-8459-d5fa35c6a243 service nova] Creating event network-vif-deleted:a3b20ac7-62d6-43cf-93f6-146ca5fdecbe for instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e on hv-cinder-83697 Jun 20 15:02:46.669285 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-2a9e5adb-7b8f-4bac-941d-ae7b674c7ce6 req-0024386d-5cbd-4c71-8459-d5fa35c6a243 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031946 Jun 20 15:02:46.670325 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 451/918] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:02:46.996820 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-098fd468-c4af-4bfb-b0ff-81f5a4a20770 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:46.997466 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-098fd468-c4af-4bfb-b0ff-81f5a4a20770 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:47.004452 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-098fd468-c4af-4bfb-b0ff-81f5a4a20770 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:47.005003 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-098fd468-c4af-4bfb-b0ff-81f5a4a20770 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:47.005859 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-098fd468-c4af-4bfb-b0ff-81f5a4a20770 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:47.006367 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-098fd468-c4af-4bfb-b0ff-81f5a4a20770 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:47.154426 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-098fd468-c4af-4bfb-b0ff-81f5a4a20770 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:47.162890 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-098fd468-c4af-4bfb-b0ff-81f5a4a20770 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1570 microversion: 2.1 time: 0.171144 Jun 20 15:02:47.163463 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 468/919] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:46 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:47.385389 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ae23f8c5-f04c-42df-b6f0-cdf687771e76 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:47.386096 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ae23f8c5-f04c-42df-b6f0-cdf687771e76 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:47.392814 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ae23f8c5-f04c-42df-b6f0-cdf687771e76 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:47.393282 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ae23f8c5-f04c-42df-b6f0-cdf687771e76 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:47.394105 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ae23f8c5-f04c-42df-b6f0-cdf687771e76 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:47.394885 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ae23f8c5-f04c-42df-b6f0-cdf687771e76 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:47.410873 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-ae23f8c5-f04c-42df-b6f0-cdf687771e76 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] HTTP exception thrown: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ae23f8c5-f04c-42df-b6f0-cdf687771e76 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Request method failure captured: Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e HTTP/1.1 Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisItx-olQt3Xnw7fzDk9YrD9SYPRuwGX18bMpRghoO90GZoV08KVgMkbR49fiL2M9AQIKHpB63zi-spyHRpMnf_4Oo-z68Zfg5VZuaJHQE4b-xiU0R2_pSgWiIw1vRNgxaAAKO59YUiV4lsgCrcdkqtHWlPOjvZPbO7JOHZayso6hj4I Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: d70851020f444aeeaa7a5cb23615719f Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 15:02:47.412617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 15:02:47.414280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d70851020f444aeeaa7a5cb23615719f"}]}] Jun 20 15:02:47.414280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:02:47.414280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: d70851020f444aeeaa7a5cb23615719f Jun 20 15:02:47.414280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:02:47.414280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-AttachVolumeTestJSON-1867415-project Jun 20 15:02:47.414280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 15:02:47.414280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 15:02:47.414280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 5a547b71ff3848ea97f77c9664a7068e Jun 20 15:02:47.414280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-AttachVolumeTestJSON-1867415-project Jun 20 15:02:47.414280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 15:02:47.414280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. Jun 20 15:02:47.414280 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': '1d7eb8d0-d6c0-4416-9d51-b8e7c732800e'} Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 15:02:47.417489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. Jun 20 15:02:47.419050 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:02:47.420470 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ae23f8c5-f04c-42df-b6f0-cdf687771e76 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Returning 404 to user: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 15:02:47.420470 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ae23f8c5-f04c-42df-b6f0-cdf687771e76 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 404 len: 111 microversion: 2.1 time: 0.033919 Jun 20 15:02:47.420470 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 452/920] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:47 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 15:02:47.423445 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-73014786-8cdc-4367-9ebf-23d0f8fc72ce tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '.version_select at 0x7fce509f21f0>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:47.449154 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-73014786-8cdc-4367-9ebf-23d0f8fc72ce tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-927469104" status: 202 len: 0 microversion: 2.1 time: 0.029476 Jun 20 15:02:47.449723 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 469/921] 10.222.0.23 () {58 vars in 1217 bytes} [Mon Jun 20 15:02:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-927469104 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 15:02:48.106352 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-dff749dc-e400-4ed5-97b9-2eac9100eba7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Action: 'create', calling method: .version_select at 0x7fce50a56670>, body: {"keypair": {"name": "tempest-keypair-1680310193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0yvE+66I6ZVZO3MI59bbeITuChXhA9mQH1SFm9W54CxsuqeSr739FRpyyWGwf3wMByZQforAMPI8sZL3XenOp9SBvnZ3A3TzxfDcNw2bQFuIaikbZp1+k4q5ToS9hADQ=="}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:02:48.120820 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-dff749dc-e400-4ed5-97b9-2eac9100eba7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Getting quotas for project d70851020f444aeeaa7a5cb23615719f. Resources: {'key_pairs'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 15:02:48.124826 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.quota [None req-dff749dc-e400-4ed5-97b9-2eac9100eba7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Getting quotas for user 5a547b71ff3848ea97f77c9664a7068e and project d70851020f444aeeaa7a5cb23615719f. Resources: {'key_pairs'} {{(pid=123978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 15:02:48.155141 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-dff749dc-e400-4ed5-97b9-2eac9100eba7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052552 Jun 20 15:02:48.155694 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 453/922] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Jun 20 15:02:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:02:48.181893 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9d163d0d-9e66-4f7e-b0c6-f8336c6790f4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:48.182983 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9d163d0d-9e66-4f7e-b0c6-f8336c6790f4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:48.191189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9d163d0d-9e66-4f7e-b0c6-f8336c6790f4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:48.191580 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9d163d0d-9e66-4f7e-b0c6-f8336c6790f4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:48.193109 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9d163d0d-9e66-4f7e-b0c6-f8336c6790f4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:48.193561 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9d163d0d-9e66-4f7e-b0c6-f8336c6790f4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:48.409184 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9d163d0d-9e66-4f7e-b0c6-f8336c6790f4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:48.417565 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9d163d0d-9e66-4f7e-b0c6-f8336c6790f4 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1570 microversion: 2.1 time: 0.241827 Jun 20 15:02:48.418149 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 470/923] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:48 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1570 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:49.435438 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-8488c9a5-d150-421c-ac64-2b7c6c4665ec tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:49.436040 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-8488c9a5-d150-421c-ac64-2b7c6c4665ec tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:49.445743 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8488c9a5-d150-421c-ac64-2b7c6c4665ec tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:49.446185 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8488c9a5-d150-421c-ac64-2b7c6c4665ec tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:49.446948 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8488c9a5-d150-421c-ac64-2b7c6c4665ec tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:49.447377 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-8488c9a5-d150-421c-ac64-2b7c6c4665ec tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:49.469015 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-906805900", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdd7e8d5-15a5-4084-b9ed-420beae9e4cd"}], "security_groups": [{"name": "tempest-securitygroup--92250382"}], "key_name": "tempest-keypair-1680310193", "user_data": "}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:02:49.573884 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.network.neutron [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] validate_networks() for [('bdd7e8d5-15a5-4084-b9ed-420beae9e4cd', None, None, None, None, None)] {{(pid=123979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 15:02:49.588352 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-8488c9a5-d150-421c-ac64-2b7c6c4665ec tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:49.596189 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-8488c9a5-d150-421c-ac64-2b7c6c4665ec tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1570 microversion: 2.1 time: 0.165464 Jun 20 15:02:49.596805 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 454/924] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:49 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:49.962737 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Flavor limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 15:02:49.963291 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Image limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 15:02:49.963892 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Flavor pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 15:02:49.964324 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Image pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 15:02:49.964752 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 15:02:49.974700 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:49.975174 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:49.975969 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:49.976399 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:49.993152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Getting quotas for project d70851020f444aeeaa7a5cb23615719f. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 15:02:49.997093 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Getting quotas for user 5a547b71ff3848ea97f77c9664a7068e and project d70851020f444aeeaa7a5cb23615719f. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 15:02:50.008328 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Going to run 1 instances... {{(pid=123979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 15:02:50.010695 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 15:02:50.062132 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-4c55684d-8b6e-4371-8118-40790768c25c tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.597214 Jun 20 15:02:50.064759 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 471/925] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 15:02:49 2022] POST /compute/v2.1/servers => generated 400 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 15:02:50.073382 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b5c69daf-7b99-476c-bae0-36f5bc081519 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:50.073986 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-b5c69daf-7b99-476c-bae0-36f5bc081519 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:50.128233 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-b5c69daf-7b99-476c-bae0-36f5bc081519 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:50.135061 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b5c69daf-7b99-476c-bae0-36f5bc081519 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 200 len: 1237 microversion: 2.1 time: 0.065633 Jun 20 15:02:50.135615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 455/926] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:50 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 15:02:50.614628 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-8ccb1091-6511-4678-9284-85fb1ea0f987 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:50.615439 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-8ccb1091-6511-4678-9284-85fb1ea0f987 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:50.622289 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8ccb1091-6511-4678-9284-85fb1ea0f987 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:50.623042 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8ccb1091-6511-4678-9284-85fb1ea0f987 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:50.623856 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8ccb1091-6511-4678-9284-85fb1ea0f987 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:50.624288 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-8ccb1091-6511-4678-9284-85fb1ea0f987 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:50.767648 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-8ccb1091-6511-4678-9284-85fb1ea0f987 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:50.775941 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-8ccb1091-6511-4678-9284-85fb1ea0f987 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1511 microversion: 2.1 time: 0.165905 Jun 20 15:02:50.776512 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 472/927] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:50 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:50.792468 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-199dad33-dd5e-49dd-8b74-086187de45a2 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:02:50.793064 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-199dad33-dd5e-49dd-8b74-086187de45a2 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:50.801152 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-199dad33-dd5e-49dd-8b74-086187de45a2 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:50.801813 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-199dad33-dd5e-49dd-8b74-086187de45a2 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:50.802576 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-199dad33-dd5e-49dd-8b74-086187de45a2 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:50.803004 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-199dad33-dd5e-49dd-8b74-086187de45a2 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:50.900949 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-199dad33-dd5e-49dd-8b74-086187de45a2 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "POST /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352/action" status: 202 len: 0 microversion: 2.1 time: 0.112304 Jun 20 15:02:50.901563 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 456/928] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Jun 20 15:02:50 2022] POST /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 15:02:50.909756 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-191b3e8b-e80a-49e0-80cc-21742478e5b6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:50.910566 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-191b3e8b-e80a-49e0-80cc-21742478e5b6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:50.916834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-191b3e8b-e80a-49e0-80cc-21742478e5b6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:50.917280 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-191b3e8b-e80a-49e0-80cc-21742478e5b6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:50.918047 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-191b3e8b-e80a-49e0-80cc-21742478e5b6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:50.918477 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-191b3e8b-e80a-49e0-80cc-21742478e5b6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:51.145433 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-191b3e8b-e80a-49e0-80cc-21742478e5b6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:51.155612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-191b3e8b-e80a-49e0-80cc-21742478e5b6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1519 microversion: 2.1 time: 0.249584 Jun 20 15:02:51.159896 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f9ba6bd4-623d-481e-a131-6b66a9cce339 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:51.161952 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f9ba6bd4-623d-481e-a131-6b66a9cce339 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:51.162092 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 473/929] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:50 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:51.177377 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f9ba6bd4-623d-481e-a131-6b66a9cce339 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:51.179427 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f9ba6bd4-623d-481e-a131-6b66a9cce339 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:51.189240 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f9ba6bd4-623d-481e-a131-6b66a9cce339 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:51.189901 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f9ba6bd4-623d-481e-a131-6b66a9cce339 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:51.294485 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f9ba6bd4-623d-481e-a131-6b66a9cce339 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:51.315102 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f9ba6bd4-623d-481e-a131-6b66a9cce339 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 200 len: 1307 microversion: 2.1 time: 0.166605 Jun 20 15:02:51.315678 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 457/930] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:51 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 1307 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 15:02:52.182355 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-93435814-ccd4-4eb8-ba96-10144e6c81b2 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:52.183129 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-93435814-ccd4-4eb8-ba96-10144e6c81b2 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:52.203383 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-93435814-ccd4-4eb8-ba96-10144e6c81b2 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:52.204685 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-93435814-ccd4-4eb8-ba96-10144e6c81b2 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:52.205791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-93435814-ccd4-4eb8-ba96-10144e6c81b2 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:52.206445 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-93435814-ccd4-4eb8-ba96-10144e6c81b2 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:52.333982 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3b53c906-30a5-4ddc-ace0-1343c53ca944 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:52.334670 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-3b53c906-30a5-4ddc-ace0-1343c53ca944 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:52.341552 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3b53c906-30a5-4ddc-ace0-1343c53ca944 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:52.342355 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3b53c906-30a5-4ddc-ace0-1343c53ca944 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:52.343316 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3b53c906-30a5-4ddc-ace0-1343c53ca944 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:52.343972 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3b53c906-30a5-4ddc-ace0-1343c53ca944 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:52.362075 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-93435814-ccd4-4eb8-ba96-10144e6c81b2 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:52.374686 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-93435814-ccd4-4eb8-ba96-10144e6c81b2 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1577 microversion: 2.1 time: 0.204492 Jun 20 15:02:52.375281 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 474/931] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:52 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1577 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:52.569900 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-f0b6a88d-f43d-4ba0-af73-2b68754201f9 req-45ffcf71-0138-4224-8dc8-acb80620c337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f9ab17-ba92-425c-b79e-ace0b9666352", "name": "network-vif-unplugged", "status": "completed", "tag": "39c85ef4-03a3-4009-bf95-8bd7df3230ea"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:02:52.584160 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-f0b6a88d-f43d-4ba0-af73-2b68754201f9 req-45ffcf71-0138-4224-8dc8-acb80620c337 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:52.585214 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-f0b6a88d-f43d-4ba0-af73-2b68754201f9 req-45ffcf71-0138-4224-8dc8-acb80620c337 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:52.598433 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-f0b6a88d-f43d-4ba0-af73-2b68754201f9 req-45ffcf71-0138-4224-8dc8-acb80620c337 service nova] Creating event network-vif-unplugged:39c85ef4-03a3-4009-bf95-8bd7df3230ea for instance 69f9ab17-ba92-425c-b79e-ace0b9666352 on hv-cinder-83697 Jun 20 15:02:52.605192 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-f0b6a88d-f43d-4ba0-af73-2b68754201f9 req-45ffcf71-0138-4224-8dc8-acb80620c337 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041102 Jun 20 15:02:52.606119 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 475/932] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:02:52.829030 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-3b53c906-30a5-4ddc-ace0-1343c53ca944 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:52.841874 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-3b53c906-30a5-4ddc-ace0-1343c53ca944 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 200 len: 1361 microversion: 2.1 time: 0.513214 Jun 20 15:02:52.842938 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 458/933] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:52 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 1361 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:53.022449 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-b9956c03-5bee-4e16-a10b-b016438df542 req-6c54f234-77de-4af6-8486-fe9730a2d0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2f69f4-aa64-494d-8002-a96c822781d9", "tag": "c7c3f6b1-903b-49c1-ad27-611edff47049"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:02:53.033301 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-b9956c03-5bee-4e16-a10b-b016438df542 req-6c54f234-77de-4af6-8486-fe9730a2d0a9 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:53.034095 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-b9956c03-5bee-4e16-a10b-b016438df542 req-6c54f234-77de-4af6-8486-fe9730a2d0a9 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:53.061215 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-b9956c03-5bee-4e16-a10b-b016438df542 req-6c54f234-77de-4af6-8486-fe9730a2d0a9 service nova] Creating event network-changed:c7c3f6b1-903b-49c1-ad27-611edff47049 for instance ed2f69f4-aa64-494d-8002-a96c822781d9 on hv-cinder-83697 Jun 20 15:02:53.067026 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-b9956c03-5bee-4e16-a10b-b016438df542 req-6c54f234-77de-4af6-8486-fe9730a2d0a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049735 Jun 20 15:02:53.068364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 476/934] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:02:53.397073 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-54d115d6-79d5-4cef-91eb-2e3e1952ce95 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:53.397945 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-54d115d6-79d5-4cef-91eb-2e3e1952ce95 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:53.409198 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-54d115d6-79d5-4cef-91eb-2e3e1952ce95 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:53.409971 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-54d115d6-79d5-4cef-91eb-2e3e1952ce95 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:53.410951 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-54d115d6-79d5-4cef-91eb-2e3e1952ce95 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:53.411373 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-54d115d6-79d5-4cef-91eb-2e3e1952ce95 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:53.415816 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:02:53.637433 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-54d115d6-79d5-4cef-91eb-2e3e1952ce95 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:53.645716 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-54d115d6-79d5-4cef-91eb-2e3e1952ce95 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1577 microversion: 2.1 time: 0.255585 Jun 20 15:02:53.646316 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 459/935] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:53 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1577 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:53.861666 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0a5a7423-1850-41c0-b606-fac05c9c9633 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:53.862345 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-0a5a7423-1850-41c0-b606-fac05c9c9633 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:53.869339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0a5a7423-1850-41c0-b606-fac05c9c9633 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:53.869853 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0a5a7423-1850-41c0-b606-fac05c9c9633 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:53.870619 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0a5a7423-1850-41c0-b606-fac05c9c9633 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:53.871062 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0a5a7423-1850-41c0-b606-fac05c9c9633 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:54.013653 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0a5a7423-1850-41c0-b606-fac05c9c9633 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:54.023535 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0a5a7423-1850-41c0-b606-fac05c9c9633 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 200 len: 1361 microversion: 2.1 time: 0.167008 Jun 20 15:02:54.024107 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 477/936] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:53 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:54.663319 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-13fa1458-40f3-4dea-b1fc-c2c1ba651ccb tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:54.664032 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-13fa1458-40f3-4dea-b1fc-c2c1ba651ccb tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:54.671256 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-13fa1458-40f3-4dea-b1fc-c2c1ba651ccb tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:54.671715 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-13fa1458-40f3-4dea-b1fc-c2c1ba651ccb tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:54.672489 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-13fa1458-40f3-4dea-b1fc-c2c1ba651ccb tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:54.672965 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-13fa1458-40f3-4dea-b1fc-c2c1ba651ccb tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:54.888972 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-13fa1458-40f3-4dea-b1fc-c2c1ba651ccb tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:54.896672 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-13fa1458-40f3-4dea-b1fc-c2c1ba651ccb tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1577 microversion: 2.1 time: 0.237525 Jun 20 15:02:54.897293 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 460/937] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:54 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1577 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:55.043952 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2ef5c6ca-cfd8-4126-8ad4-ce5d94f8bffe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:55.044567 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-2ef5c6ca-cfd8-4126-8ad4-ce5d94f8bffe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:55.051871 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2ef5c6ca-cfd8-4126-8ad4-ce5d94f8bffe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:55.052314 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2ef5c6ca-cfd8-4126-8ad4-ce5d94f8bffe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:55.053190 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2ef5c6ca-cfd8-4126-8ad4-ce5d94f8bffe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:55.053607 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2ef5c6ca-cfd8-4126-8ad4-ce5d94f8bffe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:55.200431 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-2ef5c6ca-cfd8-4126-8ad4-ce5d94f8bffe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:55.208635 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-2ef5c6ca-cfd8-4126-8ad4-ce5d94f8bffe tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 200 len: 1361 microversion: 2.1 time: 0.169012 Jun 20 15:02:55.209245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 478/938] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:55 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:55.914201 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d51a4b06-6243-4a81-8314-df43887da565 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:55.914843 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-d51a4b06-6243-4a81-8314-df43887da565 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:55.921738 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d51a4b06-6243-4a81-8314-df43887da565 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:55.922179 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d51a4b06-6243-4a81-8314-df43887da565 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:55.922929 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d51a4b06-6243-4a81-8314-df43887da565 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:55.923355 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d51a4b06-6243-4a81-8314-df43887da565 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:56.056974 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-d51a4b06-6243-4a81-8314-df43887da565 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:56.067157 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d51a4b06-6243-4a81-8314-df43887da565 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1577 microversion: 2.1 time: 0.156723 Jun 20 15:02:56.067966 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 461/939] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:55 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:56.227147 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d86ddd00-8cf2-4916-b3a6-1864c7deb979 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:56.227738 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d86ddd00-8cf2-4916-b3a6-1864c7deb979 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:56.234392 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d86ddd00-8cf2-4916-b3a6-1864c7deb979 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:56.234831 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d86ddd00-8cf2-4916-b3a6-1864c7deb979 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:56.235579 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d86ddd00-8cf2-4916-b3a6-1864c7deb979 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:56.236005 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d86ddd00-8cf2-4916-b3a6-1864c7deb979 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:56.386117 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d86ddd00-8cf2-4916-b3a6-1864c7deb979 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:56.397944 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d86ddd00-8cf2-4916-b3a6-1864c7deb979 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 200 len: 1361 microversion: 2.1 time: 0.174365 Jun 20 15:02:56.398731 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 479/940] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:56 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:57.084121 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-543b92c3-f0ef-4fb1-8396-f91307344ae6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:57.084692 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-543b92c3-f0ef-4fb1-8396-f91307344ae6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:57.091613 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-543b92c3-f0ef-4fb1-8396-f91307344ae6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:57.092058 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-543b92c3-f0ef-4fb1-8396-f91307344ae6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:57.092868 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-543b92c3-f0ef-4fb1-8396-f91307344ae6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:57.093286 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-543b92c3-f0ef-4fb1-8396-f91307344ae6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:57.233685 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-543b92c3-f0ef-4fb1-8396-f91307344ae6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:57.241984 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-543b92c3-f0ef-4fb1-8396-f91307344ae6 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1577 microversion: 2.1 time: 0.161918 Jun 20 15:02:57.242564 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 462/941] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:57 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:57.422303 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-839d23f4-28ae-4fa6-a9d7-00ed22d587de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:57.423161 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-839d23f4-28ae-4fa6-a9d7-00ed22d587de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:57.431189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-839d23f4-28ae-4fa6-a9d7-00ed22d587de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:57.431634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-839d23f4-28ae-4fa6-a9d7-00ed22d587de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:57.432389 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-839d23f4-28ae-4fa6-a9d7-00ed22d587de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:57.433167 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-839d23f4-28ae-4fa6-a9d7-00ed22d587de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:57.452496 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=100 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:02:57.575458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-839d23f4-28ae-4fa6-a9d7-00ed22d587de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:57.585707 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-839d23f4-28ae-4fa6-a9d7-00ed22d587de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 200 len: 1361 microversion: 2.1 time: 0.169905 Jun 20 15:02:57.586253 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 480/942] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:57 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:58.259615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0135f785-c92a-48dc-aa39-cf97cd351e23 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:58.260209 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-0135f785-c92a-48dc-aa39-cf97cd351e23 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:58.267566 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0135f785-c92a-48dc-aa39-cf97cd351e23 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:58.268011 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0135f785-c92a-48dc-aa39-cf97cd351e23 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:58.268770 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0135f785-c92a-48dc-aa39-cf97cd351e23 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:58.269241 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0135f785-c92a-48dc-aa39-cf97cd351e23 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:58.410921 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-0135f785-c92a-48dc-aa39-cf97cd351e23 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:58.422073 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0135f785-c92a-48dc-aa39-cf97cd351e23 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1577 microversion: 2.1 time: 0.166146 Jun 20 15:02:58.422899 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 463/943] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:58 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:58.602816 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-450ce691-9702-43c6-9044-d3917db167a2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:58.603415 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-450ce691-9702-43c6-9044-d3917db167a2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:58.610245 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-450ce691-9702-43c6-9044-d3917db167a2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:58.610681 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-450ce691-9702-43c6-9044-d3917db167a2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:58.611442 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-450ce691-9702-43c6-9044-d3917db167a2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:58.611915 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-450ce691-9702-43c6-9044-d3917db167a2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:58.644634 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-2c230331-2dde-456d-9a60-1091e395b03a req-9c233bf8-cf6a-47b5-863b-83c32b6a1030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2f69f4-aa64-494d-8002-a96c822781d9", "name": "network-vif-plugged", "status": "completed", "tag": "c7c3f6b1-903b-49c1-ad27-611edff47049"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:02:58.654045 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-2c230331-2dde-456d-9a60-1091e395b03a req-9c233bf8-cf6a-47b5-863b-83c32b6a1030 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:58.654737 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-2c230331-2dde-456d-9a60-1091e395b03a req-9c233bf8-cf6a-47b5-863b-83c32b6a1030 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:58.668527 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-2c230331-2dde-456d-9a60-1091e395b03a req-9c233bf8-cf6a-47b5-863b-83c32b6a1030 service nova] Creating event network-vif-plugged:c7c3f6b1-903b-49c1-ad27-611edff47049 for instance ed2f69f4-aa64-494d-8002-a96c822781d9 on hv-cinder-83697 Jun 20 15:02:58.673912 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-2c230331-2dde-456d-9a60-1091e395b03a req-9c233bf8-cf6a-47b5-863b-83c32b6a1030 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033086 Jun 20 15:02:58.675035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 464/944] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:02:58.752955 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-450ce691-9702-43c6-9044-d3917db167a2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:58.760985 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-450ce691-9702-43c6-9044-d3917db167a2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 200 len: 1361 microversion: 2.1 time: 0.162110 Jun 20 15:02:58.761568 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 481/945] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:58 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:59.446968 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-b5c65e92-6636-49a9-8bb5-e322dc5d5d5b tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:59.448145 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-b5c65e92-6636-49a9-8bb5-e322dc5d5d5b tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:59.459796 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b5c65e92-6636-49a9-8bb5-e322dc5d5d5b tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:59.460533 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b5c65e92-6636-49a9-8bb5-e322dc5d5d5b tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:59.461846 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b5c65e92-6636-49a9-8bb5-e322dc5d5d5b tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:59.462575 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-b5c65e92-6636-49a9-8bb5-e322dc5d5d5b tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:59.608122 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-b5c65e92-6636-49a9-8bb5-e322dc5d5d5b tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:59.618159 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-b5c65e92-6636-49a9-8bb5-e322dc5d5d5b tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1577 microversion: 2.1 time: 0.179098 Jun 20 15:02:59.618746 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 465/946] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:59 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:02:59.781879 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-459d6542-d8c3-4b72-866a-1682b91656bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:02:59.782806 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-459d6542-d8c3-4b72-866a-1682b91656bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:02:59.794149 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-459d6542-d8c3-4b72-866a-1682b91656bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:59.794880 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-459d6542-d8c3-4b72-866a-1682b91656bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:59.796218 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-459d6542-d8c3-4b72-866a-1682b91656bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:02:59.796859 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-459d6542-d8c3-4b72-866a-1682b91656bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:02:59.935480 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-459d6542-d8c3-4b72-866a-1682b91656bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:02:59.947144 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-459d6542-d8c3-4b72-866a-1682b91656bd tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 200 len: 1361 microversion: 2.1 time: 0.171338 Jun 20 15:02:59.947908 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 482/947] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:02:59 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:03:00.641180 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-695000e9-4029-48d2-8eae-48993200df38 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:00.641904 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-695000e9-4029-48d2-8eae-48993200df38 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:00.644171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=6 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:00.650172 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-695000e9-4029-48d2-8eae-48993200df38 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:00.650617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-695000e9-4029-48d2-8eae-48993200df38 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:00.651371 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-695000e9-4029-48d2-8eae-48993200df38 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:00.651797 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-695000e9-4029-48d2-8eae-48993200df38 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:00.799127 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-695000e9-4029-48d2-8eae-48993200df38 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:03:00.808041 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-695000e9-4029-48d2-8eae-48993200df38 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1577 microversion: 2.1 time: 0.170775 Jun 20 15:03:00.808590 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 466/948] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:03:00 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:03:00.967620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0a0265c0-60a6-43d1-af45-9fd3d34d70d5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:00.968170 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-0a0265c0-60a6-43d1-af45-9fd3d34d70d5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:00.970138 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:00.970791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=6 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:00.977741 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0a0265c0-60a6-43d1-af45-9fd3d34d70d5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:00.978204 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0a0265c0-60a6-43d1-af45-9fd3d34d70d5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:00.979001 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0a0265c0-60a6-43d1-af45-9fd3d34d70d5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:00.979433 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0a0265c0-60a6-43d1-af45-9fd3d34d70d5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:01.113083 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0a0265c0-60a6-43d1-af45-9fd3d34d70d5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:03:01.121572 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0a0265c0-60a6-43d1-af45-9fd3d34d70d5 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 200 len: 1546 microversion: 2.1 time: 0.157943 Jun 20 15:03:01.122247 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 483/949] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:03:00 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:03:01.138352 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2bce4c4a-33cc-4e67-bccf-fb1bbd802e58 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:01.138931 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2bce4c4a-33cc-4e67-bccf-fb1bbd802e58 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:01.145890 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2bce4c4a-33cc-4e67-bccf-fb1bbd802e58 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:01.146418 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2bce4c4a-33cc-4e67-bccf-fb1bbd802e58 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:01.147203 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2bce4c4a-33cc-4e67-bccf-fb1bbd802e58 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:01.147636 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2bce4c4a-33cc-4e67-bccf-fb1bbd802e58 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:01.235263 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2bce4c4a-33cc-4e67-bccf-fb1bbd802e58 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100849 Jun 20 15:03:01.235878 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 467/950] 10.222.0.23 () {58 vars in 1274 bytes} [Mon Jun 20 15:03:01 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:03:01.828339 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1ba90a9e-97f1-475c-b623-4199ced86516 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:01.829118 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-1ba90a9e-97f1-475c-b623-4199ced86516 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:01.835745 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1ba90a9e-97f1-475c-b623-4199ced86516 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:01.836273 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1ba90a9e-97f1-475c-b623-4199ced86516 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:01.837128 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1ba90a9e-97f1-475c-b623-4199ced86516 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:01.837623 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1ba90a9e-97f1-475c-b623-4199ced86516 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:01.968783 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-1ba90a9e-97f1-475c-b623-4199ced86516 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:03:01.977374 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1ba90a9e-97f1-475c-b623-4199ced86516 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1577 microversion: 2.1 time: 0.152877 Jun 20 15:03:01.977965 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 484/951] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:03:01 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:03:02.189415 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-c7b2234c-206b-44d1-bcc7-7ed6a579d117 req-b2dfc415-5942-418e-ab0c-469659e3bab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2f69f4-aa64-494d-8002-a96c822781d9", "tag": "c7c3f6b1-903b-49c1-ad27-611edff47049"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:03:02.197774 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-c7b2234c-206b-44d1-bcc7-7ed6a579d117 req-b2dfc415-5942-418e-ab0c-469659e3bab2 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:02.198218 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-c7b2234c-206b-44d1-bcc7-7ed6a579d117 req-b2dfc415-5942-418e-ab0c-469659e3bab2 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:02.209762 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-c7b2234c-206b-44d1-bcc7-7ed6a579d117 req-b2dfc415-5942-418e-ab0c-469659e3bab2 service nova] Creating event network-changed:c7c3f6b1-903b-49c1-ad27-611edff47049 for instance ed2f69f4-aa64-494d-8002-a96c822781d9 on hv-cinder-83697 Jun 20 15:03:02.214689 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-c7b2234c-206b-44d1-bcc7-7ed6a579d117 req-b2dfc415-5942-418e-ab0c-469659e3bab2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029529 Jun 20 15:03:02.215282 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 468/952] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:03:02.844683 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-cad8c9a0-a8f6-45b9-a56a-6ab08a0573ac req-dae1b6fa-db1a-4bf3-9ec7-073e09871990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f9ab17-ba92-425c-b79e-ace0b9666352", "name": "network-vif-plugged", "status": "completed", "tag": "39c85ef4-03a3-4009-bf95-8bd7df3230ea"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:03:02.853190 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-cad8c9a0-a8f6-45b9-a56a-6ab08a0573ac req-dae1b6fa-db1a-4bf3-9ec7-073e09871990 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:02.853625 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-cad8c9a0-a8f6-45b9-a56a-6ab08a0573ac req-dae1b6fa-db1a-4bf3-9ec7-073e09871990 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:02.865111 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-cad8c9a0-a8f6-45b9-a56a-6ab08a0573ac req-dae1b6fa-db1a-4bf3-9ec7-073e09871990 service nova] Creating event network-vif-plugged:39c85ef4-03a3-4009-bf95-8bd7df3230ea for instance 69f9ab17-ba92-425c-b79e-ace0b9666352 on hv-cinder-83697 Jun 20 15:03:02.871720 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-cad8c9a0-a8f6-45b9-a56a-6ab08a0573ac req-dae1b6fa-db1a-4bf3-9ec7-073e09871990 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030682 Jun 20 15:03:02.872372 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 485/953] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:03:02.995519 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f51cd9de-b1b0-40e0-92ab-a734b144beac tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:02.996247 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f51cd9de-b1b0-40e0-92ab-a734b144beac tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:03.007969 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f51cd9de-b1b0-40e0-92ab-a734b144beac tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:03.008409 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f51cd9de-b1b0-40e0-92ab-a734b144beac tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:03.009217 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f51cd9de-b1b0-40e0-92ab-a734b144beac tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:03.009845 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f51cd9de-b1b0-40e0-92ab-a734b144beac tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:03.209621 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f51cd9de-b1b0-40e0-92ab-a734b144beac tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:03:03.217601 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f51cd9de-b1b0-40e0-92ab-a734b144beac tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1577 microversion: 2.1 time: 0.226823 Jun 20 15:03:03.218171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 469/954] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:03:02 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1577 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:03:04.235989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-88e79b78-eced-47e9-a6d9-b328f72501a3 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:04.237194 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-88e79b78-eced-47e9-a6d9-b328f72501a3 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:04.244458 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-88e79b78-eced-47e9-a6d9-b328f72501a3 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:04.244958 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-88e79b78-eced-47e9-a6d9-b328f72501a3 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:04.245866 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-88e79b78-eced-47e9-a6d9-b328f72501a3 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:04.246385 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-88e79b78-eced-47e9-a6d9-b328f72501a3 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:04.391034 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-88e79b78-eced-47e9-a6d9-b328f72501a3 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:03:04.400413 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-88e79b78-eced-47e9-a6d9-b328f72501a3 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1564 microversion: 2.1 time: 0.169230 Jun 20 15:03:04.401023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 486/955] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:03:04 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:03:13.740457 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2f17ab62-2be0-43e6-afe3-a1dc769dd070 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:13.745759 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-8cdb7331-cc47-4ff1-876b-9ec9097ec7e2 req-f664c4a9-ec8d-4dd9-82c8-b6249d74cc31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "108600b1-78ac-473f-99ef-5f8440ac73c3", "tag": "e312c7fc-f965-4d38-9d7e-fe6001e96874"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:03:13.750078 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:13.751872 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2f17ab62-2be0-43e6-afe3-a1dc769dd070 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:13.755955 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:13.756591 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=54 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:13.761115 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2f17ab62-2be0-43e6-afe3-a1dc769dd070 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:13.761556 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2f17ab62-2be0-43e6-afe3-a1dc769dd070 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:13.762319 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2f17ab62-2be0-43e6-afe3-a1dc769dd070 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:13.762744 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2f17ab62-2be0-43e6-afe3-a1dc769dd070 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:13.769495 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-8cdb7331-cc47-4ff1-876b-9ec9097ec7e2 req-f664c4a9-ec8d-4dd9-82c8-b6249d74cc31 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:13.769930 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-8cdb7331-cc47-4ff1-876b-9ec9097ec7e2 req-f664c4a9-ec8d-4dd9-82c8-b6249d74cc31 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:13.787924 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-8cdb7331-cc47-4ff1-876b-9ec9097ec7e2 req-f664c4a9-ec8d-4dd9-82c8-b6249d74cc31 service nova] Creating event network-changed:e312c7fc-f965-4d38-9d7e-fe6001e96874 for instance 108600b1-78ac-473f-99ef-5f8440ac73c3 on hv-cinder-83697 Jun 20 15:03:13.794785 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-8cdb7331-cc47-4ff1-876b-9ec9097ec7e2 req-f664c4a9-ec8d-4dd9-82c8-b6249d74cc31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052640 Jun 20 15:03:13.795318 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 487/956] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:03:13.802267 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2f17ab62-2be0-43e6-afe3-a1dc769dd070 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 15:03:13.887805 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2f17ab62-2be0-43e6-afe3-a1dc769dd070 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 204 len: 0 microversion: 2.1 time: 0.150029 Jun 20 15:03:13.891850 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 470/957] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 15:03:13 2022] DELETE /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 15:03:13.900243 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-5dd73b6c-e39a-48eb-baab-957634396604 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:13.901097 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-5dd73b6c-e39a-48eb-baab-957634396604 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:13.909819 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5dd73b6c-e39a-48eb-baab-957634396604 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:13.910265 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5dd73b6c-e39a-48eb-baab-957634396604 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:13.911256 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5dd73b6c-e39a-48eb-baab-957634396604 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:13.912003 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5dd73b6c-e39a-48eb-baab-957634396604 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:14.049652 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-5dd73b6c-e39a-48eb-baab-957634396604 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:03:14.057843 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-5dd73b6c-e39a-48eb-baab-957634396604 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1579 microversion: 2.1 time: 0.163487 Jun 20 15:03:14.058423 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 488/958] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:03:13 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 15:03:15.077307 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-be0679a5-bc63-4a43-a233-5eac727e940f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:15.077994 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-be0679a5-bc63-4a43-a233-5eac727e940f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:15.085307 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-be0679a5-bc63-4a43-a233-5eac727e940f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:15.085962 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-be0679a5-bc63-4a43-a233-5eac727e940f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:15.086536 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-be0679a5-bc63-4a43-a233-5eac727e940f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:15.086952 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-be0679a5-bc63-4a43-a233-5eac727e940f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:15.243978 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-be0679a5-bc63-4a43-a233-5eac727e940f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:03:15.252435 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-be0679a5-bc63-4a43-a233-5eac727e940f tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1579 microversion: 2.1 time: 0.180337 Jun 20 15:03:15.260235 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 471/959] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:03:15 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1579 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:03:16.006044 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-193399a2-175a-42e2-b737-fb95187cda3f req-58da7480-e7e8-4772-9235-161fcc12e662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "108600b1-78ac-473f-99ef-5f8440ac73c3", "name": "network-vif-deleted", "tag": "e312c7fc-f965-4d38-9d7e-fe6001e96874"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:03:16.016971 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-193399a2-175a-42e2-b737-fb95187cda3f req-58da7480-e7e8-4772-9235-161fcc12e662 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:16.017411 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-193399a2-175a-42e2-b737-fb95187cda3f req-58da7480-e7e8-4772-9235-161fcc12e662 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:16.029880 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-193399a2-175a-42e2-b737-fb95187cda3f req-58da7480-e7e8-4772-9235-161fcc12e662 service nova] Creating event network-vif-deleted:e312c7fc-f965-4d38-9d7e-fe6001e96874 for instance 108600b1-78ac-473f-99ef-5f8440ac73c3 on hv-cinder-83697 Jun 20 15:03:16.035432 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-193399a2-175a-42e2-b737-fb95187cda3f req-58da7480-e7e8-4772-9235-161fcc12e662 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033289 Jun 20 15:03:16.036268 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 489/960] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:03:16.269988 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-a23d75e8-5e2b-4264-89f7-0fb87c232b3b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:16.270725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-a23d75e8-5e2b-4264-89f7-0fb87c232b3b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:16.277716 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a23d75e8-5e2b-4264-89f7-0fb87c232b3b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:16.278158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a23d75e8-5e2b-4264-89f7-0fb87c232b3b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:16.279607 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a23d75e8-5e2b-4264-89f7-0fb87c232b3b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:16.280040 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-a23d75e8-5e2b-4264-89f7-0fb87c232b3b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:16.352580 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-a23d75e8-5e2b-4264-89f7-0fb87c232b3b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:03:16.361662 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-a23d75e8-5e2b-4264-89f7-0fb87c232b3b tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 200 len: 1226 microversion: 2.1 time: 0.095610 Jun 20 15:03:16.362571 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 472/961] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:03:16 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:03:17.384418 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-45986482-3fd8-4485-a81c-3188e78d0914 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:17.385023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-45986482-3fd8-4485-a81c-3188e78d0914 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: 108600b1-78ac-473f-99ef-5f8440ac73c3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:17.391913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-45986482-3fd8-4485-a81c-3188e78d0914 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:17.392338 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-45986482-3fd8-4485-a81c-3188e78d0914 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:17.393171 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-45986482-3fd8-4485-a81c-3188e78d0914 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:17.393603 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-45986482-3fd8-4485-a81c-3188e78d0914 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:17.407316 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-45986482-3fd8-4485-a81c-3188e78d0914 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] HTTP exception thrown: Instance 108600b1-78ac-473f-99ef-5f8440ac73c3 could not be found. Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-45986482-3fd8-4485-a81c-3188e78d0914 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Request method failure captured: Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 HTTP/1.1 Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisIqpXGBp8B1v5MGZCRNAyGekWqImq1Piz28txwlbH_fF3dL1v6RFgdwmZ-ToYeloE4W-TtPwM5aj5AHftuvRtrX8ZtO5dVF9xJvAOdezwBDa1eTBq613LsfvAns5nPoK3H1QLtGc1o6xt74G4kngqwuhX0KaOiRJMJ_Xh6bCB2oqAtw Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: c4515b09c1944036b62a40cc5e88719e Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-TestVolumeBootPattern-787701414 Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 15:03:17.408979 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 15:03:17.410468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4515b09c1944036b62a40cc5e88719e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4515b09c1944036b62a40cc5e88719e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4515b09c1944036b62a40cc5e88719e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4515b09c1944036b62a40cc5e88719e"}]}] Jun 20 15:03:17.410468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-TestVolumeBootPattern-787701414 Jun 20 15:03:17.410468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: c4515b09c1944036b62a40cc5e88719e Jun 20 15:03:17.410468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-TestVolumeBootPattern-787701414 Jun 20 15:03:17.410468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-TestVolumeBootPattern-787701414-project Jun 20 15:03:17.410468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 15:03:17.410468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 15:03:17.410468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 3876008710b8469c9f65a24789a58067 Jun 20 15:03:17.410468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-TestVolumeBootPattern-787701414-project Jun 20 15:03:17.410468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 15:03:17.410468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance 108600b1-78ac-473f-99ef-5f8440ac73c3 could not be found. Jun 20 15:03:17.410468 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '108600b1-78ac-473f-99ef-5f8440ac73c3'} Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 108600b1-78ac-473f-99ef-5f8440ac73c3 could not be found. Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 15:03:17.411370 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 108600b1-78ac-473f-99ef-5f8440ac73c3 could not be found. Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 108600b1-78ac-473f-99ef-5f8440ac73c3 could not be found. Jun 20 15:03:17.412989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:03:17.414551 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-45986482-3fd8-4485-a81c-3188e78d0914 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Returning 404 to user: Instance 108600b1-78ac-473f-99ef-5f8440ac73c3 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 15:03:17.414551 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-45986482-3fd8-4485-a81c-3188e78d0914 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3" status: 404 len: 111 microversion: 2.1 time: 0.033459 Jun 20 15:03:17.414551 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 490/962] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:03:17 2022] GET /compute/v2.1/servers/108600b1-78ac-473f-99ef-5f8440ac73c3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 15:03:20.559704 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-37f9152c-ca42-4fb5-a8e4-3cc4a2cd7139 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:20.560274 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-37f9152c-ca42-4fb5-a8e4-3cc4a2cd7139 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:20.561557 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-62405f36-6e3e-4415-a54c-92ad0a46a173 req-11db980a-23e0-44f3-9579-48b29e0e0bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d491eee1-9ae6-4a88-b3d1-cda530e8f1e0", "tag": "e68a946e-bfca-40bd-9849-6e3aa603cf23"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:03:20.567617 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-37f9152c-ca42-4fb5-a8e4-3cc4a2cd7139 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:20.568072 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-37f9152c-ca42-4fb5-a8e4-3cc4a2cd7139 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:20.568927 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-37f9152c-ca42-4fb5-a8e4-3cc4a2cd7139 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:20.569320 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-37f9152c-ca42-4fb5-a8e4-3cc4a2cd7139 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:20.570805 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-62405f36-6e3e-4415-a54c-92ad0a46a173 req-11db980a-23e0-44f3-9579-48b29e0e0bb6 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:20.571225 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-62405f36-6e3e-4415-a54c-92ad0a46a173 req-11db980a-23e0-44f3-9579-48b29e0e0bb6 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:20.583495 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-62405f36-6e3e-4415-a54c-92ad0a46a173 req-11db980a-23e0-44f3-9579-48b29e0e0bb6 service nova] Creating event network-changed:e68a946e-bfca-40bd-9849-6e3aa603cf23 for instance d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 on hv-cinder-83697 Jun 20 15:03:20.589235 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-62405f36-6e3e-4415-a54c-92ad0a46a173 req-11db980a-23e0-44f3-9579-48b29e0e0bb6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031762 Jun 20 15:03:20.589924 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 491/963] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:03:20.601942 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-37f9152c-ca42-4fb5-a8e4-3cc4a2cd7139 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 15:03:20.690160 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-37f9152c-ca42-4fb5-a8e4-3cc4a2cd7139 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 204 len: 0 microversion: 2.1 time: 0.134909 Jun 20 15:03:20.691104 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 473/964] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 15:03:20 2022] DELETE /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 15:03:20.701658 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-541836ea-4d97-4b3d-8b20-62e37d6cc744 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:20.702496 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-541836ea-4d97-4b3d-8b20-62e37d6cc744 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:20.709970 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-541836ea-4d97-4b3d-8b20-62e37d6cc744 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:20.710529 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-541836ea-4d97-4b3d-8b20-62e37d6cc744 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:20.711373 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-541836ea-4d97-4b3d-8b20-62e37d6cc744 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:20.711866 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-541836ea-4d97-4b3d-8b20-62e37d6cc744 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:20.861105 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-541836ea-4d97-4b3d-8b20-62e37d6cc744 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:03:20.870783 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-541836ea-4d97-4b3d-8b20-62e37d6cc744 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1578 microversion: 2.1 time: 0.174210 Jun 20 15:03:20.871655 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 492/965] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:03:20 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:03:21.889298 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2c5f0f5e-4e6b-4005-98b2-d8aea6f14a18 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:21.889987 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2c5f0f5e-4e6b-4005-98b2-d8aea6f14a18 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:21.896943 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2c5f0f5e-4e6b-4005-98b2-d8aea6f14a18 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:21.897384 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2c5f0f5e-4e6b-4005-98b2-d8aea6f14a18 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:21.898142 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2c5f0f5e-4e6b-4005-98b2-d8aea6f14a18 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:21.898565 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2c5f0f5e-4e6b-4005-98b2-d8aea6f14a18 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:22.038969 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2c5f0f5e-4e6b-4005-98b2-d8aea6f14a18 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:03:22.047262 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2c5f0f5e-4e6b-4005-98b2-d8aea6f14a18 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1578 microversion: 2.1 time: 0.162213 Jun 20 15:03:22.056817 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 474/966] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:03:21 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:03:22.872889 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-43447b50-3dc6-4f68-8754-553f73a80560 req-497c091a-5c5c-46bd-b1f3-3e9c7480ab21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d491eee1-9ae6-4a88-b3d1-cda530e8f1e0", "name": "network-vif-deleted", "tag": "e68a946e-bfca-40bd-9849-6e3aa603cf23"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:03:22.882051 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-43447b50-3dc6-4f68-8754-553f73a80560 req-497c091a-5c5c-46bd-b1f3-3e9c7480ab21 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:22.882483 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-43447b50-3dc6-4f68-8754-553f73a80560 req-497c091a-5c5c-46bd-b1f3-3e9c7480ab21 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:22.894237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-43447b50-3dc6-4f68-8754-553f73a80560 req-497c091a-5c5c-46bd-b1f3-3e9c7480ab21 service nova] Creating event network-vif-deleted:e68a946e-bfca-40bd-9849-6e3aa603cf23 for instance d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 on hv-cinder-83697 Jun 20 15:03:22.899196 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-43447b50-3dc6-4f68-8754-553f73a80560 req-497c091a-5c5c-46bd-b1f3-3e9c7480ab21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030714 Jun 20 15:03:22.899894 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 493/967] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:03:23.064936 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-661949c4-79e3-4604-bb9a-b5b8f9a72821 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:23.065461 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-661949c4-79e3-4604-bb9a-b5b8f9a72821 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:23.072347 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-661949c4-79e3-4604-bb9a-b5b8f9a72821 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:23.072891 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-661949c4-79e3-4604-bb9a-b5b8f9a72821 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:23.073627 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-661949c4-79e3-4604-bb9a-b5b8f9a72821 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:23.074083 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-661949c4-79e3-4604-bb9a-b5b8f9a72821 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:23.140027 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-661949c4-79e3-4604-bb9a-b5b8f9a72821 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3876008710b8469c9f65a24789a58067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4515b09c1944036b62a40cc5e88719e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:03:23.149849 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-661949c4-79e3-4604-bb9a-b5b8f9a72821 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 200 len: 1226 microversion: 2.1 time: 0.088822 Jun 20 15:03:23.159191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 475/968] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:03:23 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:03:24.170674 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ebea37a5-d793-4eda-b83d-d03927e26d84 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:24.171531 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ebea37a5-d793-4eda-b83d-d03927e26d84 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: d491eee1-9ae6-4a88-b3d1-cda530e8f1e0] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:24.179815 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ebea37a5-d793-4eda-b83d-d03927e26d84 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:24.180368 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ebea37a5-d793-4eda-b83d-d03927e26d84 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:24.181454 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ebea37a5-d793-4eda-b83d-d03927e26d84 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:24.181900 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ebea37a5-d793-4eda-b83d-d03927e26d84 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:24.195639 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-ebea37a5-d793-4eda-b83d-d03927e26d84 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] HTTP exception thrown: Instance d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 could not be found. Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ebea37a5-d793-4eda-b83d-d03927e26d84 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Request method failure captured: Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 HTTP/1.1 Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisIqpXGBp8B1v5MGZCRNAyGekWqImq1Piz28txwlbH_fF3dL1v6RFgdwmZ-ToYeloE4W-TtPwM5aj5AHftuvRtrX8ZtO5dVF9xJvAOdezwBDa1eTBq613LsfvAns5nPoK3H1QLtGc1o6xt74G4kngqwuhX0KaOiRJMJ_Xh6bCB2oqAtw Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: c4515b09c1944036b62a40cc5e88719e Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-TestVolumeBootPattern-787701414 Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 15:03:24.197311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 15:03:24.198823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4515b09c1944036b62a40cc5e88719e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4515b09c1944036b62a40cc5e88719e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4515b09c1944036b62a40cc5e88719e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4515b09c1944036b62a40cc5e88719e"}]}] Jun 20 15:03:24.198823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-TestVolumeBootPattern-787701414 Jun 20 15:03:24.198823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: c4515b09c1944036b62a40cc5e88719e Jun 20 15:03:24.198823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-TestVolumeBootPattern-787701414 Jun 20 15:03:24.198823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-TestVolumeBootPattern-787701414-project Jun 20 15:03:24.198823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 15:03:24.198823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 15:03:24.198823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 3876008710b8469c9f65a24789a58067 Jun 20 15:03:24.198823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-TestVolumeBootPattern-787701414-project Jun 20 15:03:24.198823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 15:03:24.198823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 could not be found. Jun 20 15:03:24.198823 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': 'd491eee1-9ae6-4a88-b3d1-cda530e8f1e0'} Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 could not be found. Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 15:03:24.199612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 could not be found. Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 could not be found. Jun 20 15:03:24.200883 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:03:24.202037 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ebea37a5-d793-4eda-b83d-d03927e26d84 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Returning 404 to user: Instance d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 15:03:24.202037 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ebea37a5-d793-4eda-b83d-d03927e26d84 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0" status: 404 len: 111 microversion: 2.1 time: 0.034689 Jun 20 15:03:24.202037 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 494/969] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:03:24 2022] GET /compute/v2.1/servers/d491eee1-9ae6-4a88-b3d1-cda530e8f1e0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 15:03:24.650583 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-473bce96-e284-436f-9fbf-71ab7f5dd803 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:24.651101 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-473bce96-e284-436f-9fbf-71ab7f5dd803 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:24.657948 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-473bce96-e284-436f-9fbf-71ab7f5dd803 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:24.658399 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-473bce96-e284-436f-9fbf-71ab7f5dd803 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:24.659152 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-473bce96-e284-436f-9fbf-71ab7f5dd803 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:24.659583 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-473bce96-e284-436f-9fbf-71ab7f5dd803 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:24.673264 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-473bce96-e284-436f-9fbf-71ab7f5dd803 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] HTTP exception thrown: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-473bce96-e284-436f-9fbf-71ab7f5dd803 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Request method failure captured: Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: DELETE /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 HTTP/1.1 Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisIqpXGBp8B1v5MGZCRNAyGekWqImq1Piz28txwlbH_fF3dL1v6RFgdwmZ-ToYeloE4W-TtPwM5aj5AHftuvRtrX8ZtO5dVF9xJvAOdezwBDa1eTBq613LsfvAns5nPoK3H1QLtGc1o6xt74G4kngqwuhX0KaOiRJMJ_Xh6bCB2oqAtw Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: c4515b09c1944036b62a40cc5e88719e Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-TestVolumeBootPattern-787701414 Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 15:03:24.674914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 15:03:24.676513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4515b09c1944036b62a40cc5e88719e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4515b09c1944036b62a40cc5e88719e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4515b09c1944036b62a40cc5e88719e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4515b09c1944036b62a40cc5e88719e"}]}] Jun 20 15:03:24.676513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-TestVolumeBootPattern-787701414 Jun 20 15:03:24.676513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: c4515b09c1944036b62a40cc5e88719e Jun 20 15:03:24.676513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-TestVolumeBootPattern-787701414 Jun 20 15:03:24.676513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-TestVolumeBootPattern-787701414-project Jun 20 15:03:24.676513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 15:03:24.676513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 15:03:24.676513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 3876008710b8469c9f65a24789a58067 Jun 20 15:03:24.676513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-TestVolumeBootPattern-787701414-project Jun 20 15:03:24.676513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 15:03:24.676513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. Jun 20 15:03:24.676513 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': 'b3dceca0-38a5-404e-bc35-fd76511a1be5'} Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 15:03:24.677647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. Jun 20 15:03:24.679223 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:03:24.680833 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-473bce96-e284-436f-9fbf-71ab7f5dd803 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Returning 404 to user: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 15:03:24.680833 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-473bce96-e284-436f-9fbf-71ab7f5dd803 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 404 len: 111 microversion: 2.1 time: 0.029734 Jun 20 15:03:24.680833 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 476/970] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 15:03:24 2022] DELETE /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 15:03:24.685614 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2fe7b29d-8c3c-41c4-a4f0-890b795be6ef tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:24.686237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-2fe7b29d-8c3c-41c4-a4f0-890b795be6ef tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] [instance: b3dceca0-38a5-404e-bc35-fd76511a1be5] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:24.692378 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2fe7b29d-8c3c-41c4-a4f0-890b795be6ef tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:24.692860 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2fe7b29d-8c3c-41c4-a4f0-890b795be6ef tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:24.693611 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2fe7b29d-8c3c-41c4-a4f0-890b795be6ef tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:24.694014 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-2fe7b29d-8c3c-41c4-a4f0-890b795be6ef tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:24.707771 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-2fe7b29d-8c3c-41c4-a4f0-890b795be6ef tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] HTTP exception thrown: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2fe7b29d-8c3c-41c4-a4f0-890b795be6ef tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Request method failure captured: Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 HTTP/1.1 Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisIqpXGBp8B1v5MGZCRNAyGekWqImq1Piz28txwlbH_fF3dL1v6RFgdwmZ-ToYeloE4W-TtPwM5aj5AHftuvRtrX8ZtO5dVF9xJvAOdezwBDa1eTBq613LsfvAns5nPoK3H1QLtGc1o6xt74G4kngqwuhX0KaOiRJMJ_Xh6bCB2oqAtw Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: c4515b09c1944036b62a40cc5e88719e Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-TestVolumeBootPattern-787701414 Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 15:03:24.709309 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 15:03:24.710950 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4515b09c1944036b62a40cc5e88719e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4515b09c1944036b62a40cc5e88719e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4515b09c1944036b62a40cc5e88719e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4515b09c1944036b62a40cc5e88719e"}]}] Jun 20 15:03:24.710950 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-TestVolumeBootPattern-787701414 Jun 20 15:03:24.710950 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: c4515b09c1944036b62a40cc5e88719e Jun 20 15:03:24.710950 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-TestVolumeBootPattern-787701414 Jun 20 15:03:24.710950 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-TestVolumeBootPattern-787701414-project Jun 20 15:03:24.710950 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 15:03:24.710950 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 15:03:24.710950 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 3876008710b8469c9f65a24789a58067 Jun 20 15:03:24.710950 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-TestVolumeBootPattern-787701414-project Jun 20 15:03:24.710950 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 15:03:24.710950 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. Jun 20 15:03:24.710950 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': 'b3dceca0-38a5-404e-bc35-fd76511a1be5'} Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 15:03:24.711812 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. Jun 20 15:03:24.713369 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:03:24.714684 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-2fe7b29d-8c3c-41c4-a4f0-890b795be6ef tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Returning 404 to user: Instance b3dceca0-38a5-404e-bc35-fd76511a1be5 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 15:03:24.714684 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-2fe7b29d-8c3c-41c4-a4f0-890b795be6ef tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5" status: 404 len: 111 microversion: 2.1 time: 0.029619 Jun 20 15:03:24.714684 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 495/971] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:03:24 2022] GET /compute/v2.1/servers/b3dceca0-38a5-404e-bc35-fd76511a1be5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 15:03:26.023191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-9456da6f-d162-4c94-a675-a3edecd3a507 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] Calling method '.version_select at 0x7fce50b96b80>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:26.043416 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-9456da6f-d162-4c94-a675-a3edecd3a507 tempest-TestVolumeBootPattern-787701414 tempest-TestVolumeBootPattern-787701414-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2098402945" status: 202 len: 0 microversion: 2.1 time: 0.024060 Jun 20 15:03:26.044123 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 477/972] 10.222.0.23 () {58 vars in 1262 bytes} [Mon Jun 20 15:03:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2098402945 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 15:03:38.622296 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-4bece099-e368-4e94-8a4a-fb9ff61c2022 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:38.622792 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-4bece099-e368-4e94-8a4a-fb9ff61c2022 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:38.625008 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=17 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:38.625671 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=60 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:38.631131 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4bece099-e368-4e94-8a4a-fb9ff61c2022 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:38.631571 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4bece099-e368-4e94-8a4a-fb9ff61c2022 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:38.632376 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4bece099-e368-4e94-8a4a-fb9ff61c2022 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:38.632826 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4bece099-e368-4e94-8a4a-fb9ff61c2022 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:38.657023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-4bece099-e368-4e94-8a4a-fb9ff61c2022 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/ips" status: 200 len: 144 microversion: 2.1 time: 0.039505 Jun 20 15:03:38.657591 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 496/973] 10.222.0.23 () {58 vars in 1247 bytes} [Mon Jun 20 15:03:38 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:03:39.992291 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:39.993174 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:39.999339 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7e937bf6-82e4-4ab5-930d-2a5fc6cbb4d0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff36ea8d-b73b-4f11-8ea3-9c9d892a0ad6"}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:03:40.001007 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7e937bf6-82e4-4ab5-930d-2a5fc6cbb4d0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:40.010866 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7e937bf6-82e4-4ab5-930d-2a5fc6cbb4d0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:40.011314 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7e937bf6-82e4-4ab5-930d-2a5fc6cbb4d0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:40.012078 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7e937bf6-82e4-4ab5-930d-2a5fc6cbb4d0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:40.012502 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7e937bf6-82e4-4ab5-930d-2a5fc6cbb4d0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:40.281081 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7e937bf6-82e4-4ab5-930d-2a5fc6cbb4d0 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "POST /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291207 Jun 20 15:03:40.281677 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 478/974] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 15:03:39 2022] POST /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:03:46.777830 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-bd4faae2-d4c6-4a61-bcfe-730aea317907 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:46.778765 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-bd4faae2-d4c6-4a61-bcfe-730aea317907 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:46.786125 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bd4faae2-d4c6-4a61-bcfe-730aea317907 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:46.786570 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bd4faae2-d4c6-4a61-bcfe-730aea317907 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:46.787331 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bd4faae2-d4c6-4a61-bcfe-730aea317907 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:46.787757 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-bd4faae2-d4c6-4a61-bcfe-730aea317907 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:46.817004 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-bd4faae2-d4c6-4a61-bcfe-730aea317907 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043116 Jun 20 15:03:46.817546 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 497/975] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 15:03:46 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:03:46.828595 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-0084bda1-67c2-4f33-88c1-848dd65b09e2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:46.829168 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-0084bda1-67c2-4f33-88c1-848dd65b09e2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:46.835630 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0084bda1-67c2-4f33-88c1-848dd65b09e2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:46.836075 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0084bda1-67c2-4f33-88c1-848dd65b09e2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:46.836866 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0084bda1-67c2-4f33-88c1-848dd65b09e2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:46.837304 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-0084bda1-67c2-4f33-88c1-848dd65b09e2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:46.867554 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-0084bda1-67c2-4f33-88c1-848dd65b09e2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments/ff36ea8d-b73b-4f11-8ea3-9c9d892a0ad6" status: 200 len: 194 microversion: 2.1 time: 0.043775 Jun 20 15:03:46.868133 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 479/976] 10.222.0.23 () {58 vars in 1412 bytes} [Mon Jun 20 15:03:46 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments/ff36ea8d-b73b-4f11-8ea3-9c9d892a0ad6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:03:48.205993 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-58a023d0-b6f7-4e54-9301-4914ade1521a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "330218aa-121f-44cf-84ec-8d18b166fce6"}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:03:48.207038 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-58a023d0-b6f7-4e54-9301-4914ade1521a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:48.213758 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-58a023d0-b6f7-4e54-9301-4914ade1521a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:48.214203 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-58a023d0-b6f7-4e54-9301-4914ade1521a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:48.214956 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-58a023d0-b6f7-4e54-9301-4914ade1521a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:48.215380 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-58a023d0-b6f7-4e54-9301-4914ade1521a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:48.496670 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-58a023d0-b6f7-4e54-9301-4914ade1521a tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "POST /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294392 Jun 20 15:03:48.498388 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 498/977] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 15:03:48 2022] POST /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:03:56.027240 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-73cccb7a-d1d2-452f-a85b-687c60943115 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:56.028263 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-73cccb7a-d1d2-452f-a85b-687c60943115 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:56.035302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-73cccb7a-d1d2-452f-a85b-687c60943115 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:56.035758 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-73cccb7a-d1d2-452f-a85b-687c60943115 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:56.036515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-73cccb7a-d1d2-452f-a85b-687c60943115 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:56.036976 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-73cccb7a-d1d2-452f-a85b-687c60943115 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:56.067232 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-73cccb7a-d1d2-452f-a85b-687c60943115 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044318 Jun 20 15:03:56.067785 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 480/978] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 15:03:56 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:03:56.214471 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1d3843e6-5d14-41cd-b7cb-2db5bd532da7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:56.215097 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-1d3843e6-5d14-41cd-b7cb-2db5bd532da7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:56.221913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1d3843e6-5d14-41cd-b7cb-2db5bd532da7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:56.222352 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1d3843e6-5d14-41cd-b7cb-2db5bd532da7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:56.223125 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1d3843e6-5d14-41cd-b7cb-2db5bd532da7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:56.223553 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1d3843e6-5d14-41cd-b7cb-2db5bd532da7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:56.252521 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1d3843e6-5d14-41cd-b7cb-2db5bd532da7 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments/ff36ea8d-b73b-4f11-8ea3-9c9d892a0ad6" status: 200 len: 194 microversion: 2.1 time: 0.043930 Jun 20 15:03:56.253128 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 499/979] 10.222.0.23 () {58 vars in 1412 bytes} [Mon Jun 20 15:03:56 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments/ff36ea8d-b73b-4f11-8ea3-9c9d892a0ad6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:03:56.266182 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-6f0815d4-d810-4076-8d97-e4df7af0b6b2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:56.266692 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-6f0815d4-d810-4076-8d97-e4df7af0b6b2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:56.273519 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6f0815d4-d810-4076-8d97-e4df7af0b6b2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:56.273966 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6f0815d4-d810-4076-8d97-e4df7af0b6b2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:56.274723 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6f0815d4-d810-4076-8d97-e4df7af0b6b2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:56.275238 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-6f0815d4-d810-4076-8d97-e4df7af0b6b2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:56.369457 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-6f0815d4-d810-4076-8d97-e4df7af0b6b2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lazy-loading 'services' on Instance uuid ed2f69f4-aa64-494d-8002-a96c822781d9 {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 15:03:56.446934 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-6f0815d4-d810-4076-8d97-e4df7af0b6b2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments/ff36ea8d-b73b-4f11-8ea3-9c9d892a0ad6" status: 202 len: 0 microversion: 2.1 time: 0.184744 Jun 20 15:03:56.447528 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 481/980] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 15:03:56 2022] DELETE /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments/ff36ea8d-b73b-4f11-8ea3-9c9d892a0ad6 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 15:03:57.576335 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7fc625a9-6457-4cd4-b23a-50c6181c62cb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:57.576913 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7fc625a9-6457-4cd4-b23a-50c6181c62cb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:57.583949 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7fc625a9-6457-4cd4-b23a-50c6181c62cb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:57.584399 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7fc625a9-6457-4cd4-b23a-50c6181c62cb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:57.585200 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7fc625a9-6457-4cd4-b23a-50c6181c62cb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:57.585650 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7fc625a9-6457-4cd4-b23a-50c6181c62cb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:57.614607 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7fc625a9-6457-4cd4-b23a-50c6181c62cb tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments/330218aa-121f-44cf-84ec-8d18b166fce6" status: 200 len: 194 microversion: 2.1 time: 0.042349 Jun 20 15:03:57.615143 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 500/981] 10.222.0.23 () {58 vars in 1412 bytes} [Mon Jun 20 15:03:57 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments/330218aa-121f-44cf-84ec-8d18b166fce6 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:03:57.627679 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7311b0a5-a2eb-4cd6-888d-51e70797c749 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:57.628230 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7311b0a5-a2eb-4cd6-888d-51e70797c749 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:57.635017 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7311b0a5-a2eb-4cd6-888d-51e70797c749 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:57.635948 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7311b0a5-a2eb-4cd6-888d-51e70797c749 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:57.636746 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7311b0a5-a2eb-4cd6-888d-51e70797c749 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:57.637201 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7311b0a5-a2eb-4cd6-888d-51e70797c749 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:57.722795 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-7311b0a5-a2eb-4cd6-888d-51e70797c749 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lazy-loading 'services' on Instance uuid ed2f69f4-aa64-494d-8002-a96c822781d9 {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 15:03:57.798771 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7311b0a5-a2eb-4cd6-888d-51e70797c749 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments/330218aa-121f-44cf-84ec-8d18b166fce6" status: 202 len: 0 microversion: 2.1 time: 0.175798 Jun 20 15:03:57.799391 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 482/982] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 15:03:57 2022] DELETE /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments/330218aa-121f-44cf-84ec-8d18b166fce6 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 15:03:58.974651 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-62186491-7173-4b85-9c9f-cf7654a346b6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:58.975593 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-62186491-7173-4b85-9c9f-cf7654a346b6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:58.982288 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-62186491-7173-4b85-9c9f-cf7654a346b6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:58.982731 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-62186491-7173-4b85-9c9f-cf7654a346b6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:58.983484 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-62186491-7173-4b85-9c9f-cf7654a346b6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:58.983919 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-62186491-7173-4b85-9c9f-cf7654a346b6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:59.013949 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-62186491-7173-4b85-9c9f-cf7654a346b6 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043217 Jun 20 15:03:59.014503 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 501/983] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 15:03:58 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 15:03:59.139690 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-4c1a3e51-58ef-444c-aa4b-6d45e54b7f44 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:59.140621 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-4c1a3e51-58ef-444c-aa4b-6d45e54b7f44 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:59.147452 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4c1a3e51-58ef-444c-aa4b-6d45e54b7f44 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:59.147895 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4c1a3e51-58ef-444c-aa4b-6d45e54b7f44 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:59.148644 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4c1a3e51-58ef-444c-aa4b-6d45e54b7f44 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:59.149174 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4c1a3e51-58ef-444c-aa4b-6d45e54b7f44 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:59.180986 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-4c1a3e51-58ef-444c-aa4b-6d45e54b7f44 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046105 Jun 20 15:03:59.181554 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 483/984] 10.222.0.23 () {58 vars in 1301 bytes} [Mon Jun 20 15:03:59 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 15:03:59.238356 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-aac9891c-9b58-44ee-af82-44429407a680 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:59.238850 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-aac9891c-9b58-44ee-af82-44429407a680 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:59.245038 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-aac9891c-9b58-44ee-af82-44429407a680 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:59.245528 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-aac9891c-9b58-44ee-af82-44429407a680 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:59.246816 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-aac9891c-9b58-44ee-af82-44429407a680 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:59.247522 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-aac9891c-9b58-44ee-af82-44429407a680 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:59.271754 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-aac9891c-9b58-44ee-af82-44429407a680 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Going to try to terminate instance {{(pid=123979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 15:03:59.359398 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-aac9891c-9b58-44ee-af82-44429407a680 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 204 len: 0 microversion: 2.1 time: 0.124613 Jun 20 15:03:59.359988 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 502/985] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 15:03:59 2022] DELETE /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 15:03:59.368321 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1fef7eb1-f57c-4eb6-810f-06fd44779ac9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:03:59.368985 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1fef7eb1-f57c-4eb6-810f-06fd44779ac9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:03:59.375308 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1fef7eb1-f57c-4eb6-810f-06fd44779ac9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:59.375697 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1fef7eb1-f57c-4eb6-810f-06fd44779ac9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:59.376443 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1fef7eb1-f57c-4eb6-810f-06fd44779ac9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:03:59.377023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1fef7eb1-f57c-4eb6-810f-06fd44779ac9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:03:59.758364 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1fef7eb1-f57c-4eb6-810f-06fd44779ac9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:03:59.766409 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1fef7eb1-f57c-4eb6-810f-06fd44779ac9 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 200 len: 1670 microversion: 2.1 time: 0.401961 Jun 20 15:03:59.766985 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 484/986] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:03:59 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 1670 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:04:00.786132 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-98deb11d-a0cf-451f-9693-b4fc9aa20d09 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:04:00.786898 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-98deb11d-a0cf-451f-9693-b4fc9aa20d09 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:04:00.796939 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-98deb11d-a0cf-451f-9693-b4fc9aa20d09 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:00.797536 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-98deb11d-a0cf-451f-9693-b4fc9aa20d09 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:00.798739 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-98deb11d-a0cf-451f-9693-b4fc9aa20d09 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:00.799345 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-98deb11d-a0cf-451f-9693-b4fc9aa20d09 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:00.942998 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-98deb11d-a0cf-451f-9693-b4fc9aa20d09 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:04:00.951099 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-98deb11d-a0cf-451f-9693-b4fc9aa20d09 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 200 len: 1670 microversion: 2.1 time: 0.169696 Jun 20 15:04:00.951636 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 503/987] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:04:00 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:04:01.931136 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-aae56f8d-0381-4cab-9a57-bd69cc6d4c87 req-54bc0e27-6afa-487e-990f-cd84b333c7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2f69f4-aa64-494d-8002-a96c822781d9", "name": "network-vif-deleted", "tag": "c7c3f6b1-903b-49c1-ad27-611edff47049"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:04:01.941355 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-aae56f8d-0381-4cab-9a57-bd69cc6d4c87 req-54bc0e27-6afa-487e-990f-cd84b333c7a2 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:01.941791 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-aae56f8d-0381-4cab-9a57-bd69cc6d4c87 req-54bc0e27-6afa-487e-990f-cd84b333c7a2 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:01.955309 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-aae56f8d-0381-4cab-9a57-bd69cc6d4c87 req-54bc0e27-6afa-487e-990f-cd84b333c7a2 service nova] Creating event network-vif-deleted:c7c3f6b1-903b-49c1-ad27-611edff47049 for instance ed2f69f4-aa64-494d-8002-a96c822781d9 on hv-cinder-83697 Jun 20 15:04:01.960696 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-aae56f8d-0381-4cab-9a57-bd69cc6d4c87 req-54bc0e27-6afa-487e-990f-cd84b333c7a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033231 Jun 20 15:04:01.961556 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 485/988] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:04:01.969616 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-0789f675-6a7a-433d-90f5-4106820650de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:04:01.970278 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-0789f675-6a7a-433d-90f5-4106820650de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:04:01.976780 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0789f675-6a7a-433d-90f5-4106820650de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:01.977229 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0789f675-6a7a-433d-90f5-4106820650de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:01.977993 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0789f675-6a7a-433d-90f5-4106820650de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:01.983936 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-0789f675-6a7a-433d-90f5-4106820650de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:02.057177 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-0789f675-6a7a-433d-90f5-4106820650de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a547b71ff3848ea97f77c9664a7068e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70851020f444aeeaa7a5cb23615719f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:04:02.066259 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-0789f675-6a7a-433d-90f5-4106820650de tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 200 len: 1322 microversion: 2.1 time: 0.101548 Jun 20 15:04:02.066865 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 504/989] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:04:01 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 1322 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:04:03.087818 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f22607de-c591-4a3f-981c-94e91c5a0686 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:04:03.088606 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f22607de-c591-4a3f-981c-94e91c5a0686 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:04:03.095725 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f22607de-c591-4a3f-981c-94e91c5a0686 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:03.096170 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f22607de-c591-4a3f-981c-94e91c5a0686 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:03.096983 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f22607de-c591-4a3f-981c-94e91c5a0686 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:03.097419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f22607de-c591-4a3f-981c-94e91c5a0686 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:03.111244 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-f22607de-c591-4a3f-981c-94e91c5a0686 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] HTTP exception thrown: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f22607de-c591-4a3f-981c-94e91c5a0686 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Request method failure captured: Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 HTTP/1.1 Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisItx-olQt3Xnw7fzDk9YrD9SYPRuwGX18bMpRghoO90GZoV08KVgMkbR49fiL2M9AQIKHpB63zi-spyHRpMnf_4Oo-z68Zfg5VZuaJHQE4b-xiU0R2_pSgWiIw1vRNgxaAAKO59YUiV4lsgCrcdkqtHWlPOjvZPbO7JOHZayso6hj4I Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: d70851020f444aeeaa7a5cb23615719f Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 15:04:03.112911 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 15:04:03.114561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d70851020f444aeeaa7a5cb23615719f"}]}] Jun 20 15:04:03.114561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:04:03.114561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: d70851020f444aeeaa7a5cb23615719f Jun 20 15:04:03.114561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:04:03.114561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-AttachVolumeTestJSON-1867415-project Jun 20 15:04:03.114561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 15:04:03.114561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 15:04:03.114561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 5a547b71ff3848ea97f77c9664a7068e Jun 20 15:04:03.114561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-AttachVolumeTestJSON-1867415-project Jun 20 15:04:03.114561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 15:04:03.114561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. Jun 20 15:04:03.114561 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': 'ed2f69f4-aa64-494d-8002-a96c822781d9'} Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 15:04:03.115649 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. Jun 20 15:04:03.117292 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:04:03.119066 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f22607de-c591-4a3f-981c-94e91c5a0686 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Returning 404 to user: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 15:04:03.119066 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f22607de-c591-4a3f-981c-94e91c5a0686 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 404 len: 111 microversion: 2.1 time: 0.034275 Jun 20 15:04:03.119066 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 486/990] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:04:03 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 15:04:03.123961 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-496558ef-e671-4471-9cf5-31fc27e07ed2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '.version_select at 0x7fce508bb8b0>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:04:03.146367 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-496558ef-e671-4471-9cf5-31fc27e07ed2 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680310193" status: 202 len: 0 microversion: 2.1 time: 0.026639 Jun 20 15:04:03.147107 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 505/991] 10.222.0.23 () {58 vars in 1220 bytes} [Mon Jun 20 15:04:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680310193 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 15:04:06.047388 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3ae486b0-b6ab-4aa2-8040-a8cd14bff6fc tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:04:06.047894 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-3ae486b0-b6ab-4aa2-8040-a8cd14bff6fc tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:04:06.054898 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3ae486b0-b6ab-4aa2-8040-a8cd14bff6fc tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:06.055339 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3ae486b0-b6ab-4aa2-8040-a8cd14bff6fc tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:06.056098 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3ae486b0-b6ab-4aa2-8040-a8cd14bff6fc tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:06.056530 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-3ae486b0-b6ab-4aa2-8040-a8cd14bff6fc tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:06.071620 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-3ae486b0-b6ab-4aa2-8040-a8cd14bff6fc tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] HTTP exception thrown: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3ae486b0-b6ab-4aa2-8040-a8cd14bff6fc tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Request method failure captured: Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: DELETE /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 HTTP/1.1 Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisItx-olQt3Xnw7fzDk9YrD9SYPRuwGX18bMpRghoO90GZoV08KVgMkbR49fiL2M9AQIKHpB63zi-spyHRpMnf_4Oo-z68Zfg5VZuaJHQE4b-xiU0R2_pSgWiIw1vRNgxaAAKO59YUiV4lsgCrcdkqtHWlPOjvZPbO7JOHZayso6hj4I Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: d70851020f444aeeaa7a5cb23615719f Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 15:04:06.073211 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 15:04:06.074888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d70851020f444aeeaa7a5cb23615719f"}]}] Jun 20 15:04:06.074888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:04:06.074888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: d70851020f444aeeaa7a5cb23615719f Jun 20 15:04:06.074888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:04:06.074888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-AttachVolumeTestJSON-1867415-project Jun 20 15:04:06.074888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 15:04:06.074888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 15:04:06.074888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 5a547b71ff3848ea97f77c9664a7068e Jun 20 15:04:06.074888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-AttachVolumeTestJSON-1867415-project Jun 20 15:04:06.074888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 15:04:06.074888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. Jun 20 15:04:06.074888 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': 'ed2f69f4-aa64-494d-8002-a96c822781d9'} Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 15:04:06.075763 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. Jun 20 15:04:06.077191 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:04:06.078954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-3ae486b0-b6ab-4aa2-8040-a8cd14bff6fc tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Returning 404 to user: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 15:04:06.078954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-3ae486b0-b6ab-4aa2-8040-a8cd14bff6fc tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 404 len: 111 microversion: 2.1 time: 0.031282 Jun 20 15:04:06.078954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 487/992] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 15:04:06 2022] DELETE /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 15:04:06.086925 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9eca0345-98fe-4c51-8a5f-91ac9f81ff6e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:04:06.087662 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9eca0345-98fe-4c51-8a5f-91ac9f81ff6e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: ed2f69f4-aa64-494d-8002-a96c822781d9] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:04:06.095138 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9eca0345-98fe-4c51-8a5f-91ac9f81ff6e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:06.095586 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9eca0345-98fe-4c51-8a5f-91ac9f81ff6e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:06.096349 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9eca0345-98fe-4c51-8a5f-91ac9f81ff6e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:06.096809 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9eca0345-98fe-4c51-8a5f-91ac9f81ff6e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:06.111595 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-9eca0345-98fe-4c51-8a5f-91ac9f81ff6e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] HTTP exception thrown: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9eca0345-98fe-4c51-8a5f-91ac9f81ff6e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Request method failure captured: Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 HTTP/1.1 Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisItx-olQt3Xnw7fzDk9YrD9SYPRuwGX18bMpRghoO90GZoV08KVgMkbR49fiL2M9AQIKHpB63zi-spyHRpMnf_4Oo-z68Zfg5VZuaJHQE4b-xiU0R2_pSgWiIw1vRNgxaAAKO59YUiV4lsgCrcdkqtHWlPOjvZPbO7JOHZayso6hj4I Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: d70851020f444aeeaa7a5cb23615719f Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 15:04:06.113237 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 15:04:06.114834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d70851020f444aeeaa7a5cb23615719f"}]}] Jun 20 15:04:06.114834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:04:06.114834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: d70851020f444aeeaa7a5cb23615719f Jun 20 15:04:06.114834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:04:06.114834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-AttachVolumeTestJSON-1867415-project Jun 20 15:04:06.114834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 15:04:06.114834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 15:04:06.114834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 5a547b71ff3848ea97f77c9664a7068e Jun 20 15:04:06.114834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-AttachVolumeTestJSON-1867415-project Jun 20 15:04:06.114834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 15:04:06.114834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. Jun 20 15:04:06.114834 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': 'ed2f69f4-aa64-494d-8002-a96c822781d9'} Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 15:04:06.115791 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. Jun 20 15:04:06.117072 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:04:06.118274 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9eca0345-98fe-4c51-8a5f-91ac9f81ff6e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Returning 404 to user: Instance ed2f69f4-aa64-494d-8002-a96c822781d9 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 15:04:06.118274 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9eca0345-98fe-4c51-8a5f-91ac9f81ff6e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9" status: 404 len: 111 microversion: 2.1 time: 0.034938 Jun 20 15:04:06.118274 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 506/993] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:04:06 2022] GET /compute/v2.1/servers/ed2f69f4-aa64-494d-8002-a96c822781d9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 15:04:07.268313 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-41de14b5-504a-4f4f-b542-eb6682e3ccb8 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:04:07.268821 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-41de14b5-504a-4f4f-b542-eb6682e3ccb8 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:04:07.275730 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-41de14b5-504a-4f4f-b542-eb6682e3ccb8 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:07.276175 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-41de14b5-504a-4f4f-b542-eb6682e3ccb8 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:07.277059 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-41de14b5-504a-4f4f-b542-eb6682e3ccb8 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:07.277501 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-41de14b5-504a-4f4f-b542-eb6682e3ccb8 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:07.291240 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-41de14b5-504a-4f4f-b542-eb6682e3ccb8 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] HTTP exception thrown: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-41de14b5-504a-4f4f-b542-eb6682e3ccb8 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Request method failure captured: Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: DELETE /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e HTTP/1.1 Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisItx-olQt3Xnw7fzDk9YrD9SYPRuwGX18bMpRghoO90GZoV08KVgMkbR49fiL2M9AQIKHpB63zi-spyHRpMnf_4Oo-z68Zfg5VZuaJHQE4b-xiU0R2_pSgWiIw1vRNgxaAAKO59YUiV4lsgCrcdkqtHWlPOjvZPbO7JOHZayso6hj4I Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: d70851020f444aeeaa7a5cb23615719f Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 15:04:07.292864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 15:04:07.294378 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d70851020f444aeeaa7a5cb23615719f"}]}] Jun 20 15:04:07.294378 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:04:07.294378 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: d70851020f444aeeaa7a5cb23615719f Jun 20 15:04:07.294378 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:04:07.294378 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-AttachVolumeTestJSON-1867415-project Jun 20 15:04:07.294378 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 15:04:07.294378 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 15:04:07.294378 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 5a547b71ff3848ea97f77c9664a7068e Jun 20 15:04:07.294378 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-AttachVolumeTestJSON-1867415-project Jun 20 15:04:07.294378 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 15:04:07.294378 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. Jun 20 15:04:07.294378 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': '1d7eb8d0-d6c0-4416-9d51-b8e7c732800e'} Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 15:04:07.295119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. Jun 20 15:04:07.296515 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:04:07.298094 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-41de14b5-504a-4f4f-b542-eb6682e3ccb8 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Returning 404 to user: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 15:04:07.298094 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-41de14b5-504a-4f4f-b542-eb6682e3ccb8 tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 404 len: 111 microversion: 2.1 time: 0.029871 Jun 20 15:04:07.298094 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 488/994] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 15:04:07 2022] DELETE /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 15:04:07.305294 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b3a5c906-06c3-4051-8970-eddbf32b139e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:04:07.306036 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-b3a5c906-06c3-4051-8970-eddbf32b139e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] [instance: 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:04:07.313813 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b3a5c906-06c3-4051-8970-eddbf32b139e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:07.314267 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b3a5c906-06c3-4051-8970-eddbf32b139e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:07.315080 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b3a5c906-06c3-4051-8970-eddbf32b139e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:07.315517 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-b3a5c906-06c3-4051-8970-eddbf32b139e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:07.329122 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-b3a5c906-06c3-4051-8970-eddbf32b139e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] HTTP exception thrown: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b3a5c906-06c3-4051-8970-eddbf32b139e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Request method failure captured: Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e HTTP/1.1 Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisItx-olQt3Xnw7fzDk9YrD9SYPRuwGX18bMpRghoO90GZoV08KVgMkbR49fiL2M9AQIKHpB63zi-spyHRpMnf_4Oo-z68Zfg5VZuaJHQE4b-xiU0R2_pSgWiIw1vRNgxaAAKO59YUiV4lsgCrcdkqtHWlPOjvZPbO7JOHZayso6hj4I Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: d70851020f444aeeaa7a5cb23615719f Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 15:04:07.330634 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 15:04:07.332230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d70851020f444aeeaa7a5cb23615719f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d70851020f444aeeaa7a5cb23615719f"}]}] Jun 20 15:04:07.332230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:04:07.332230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: d70851020f444aeeaa7a5cb23615719f Jun 20 15:04:07.332230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1867415 Jun 20 15:04:07.332230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-AttachVolumeTestJSON-1867415-project Jun 20 15:04:07.332230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 15:04:07.332230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 15:04:07.332230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 5a547b71ff3848ea97f77c9664a7068e Jun 20 15:04:07.332230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-AttachVolumeTestJSON-1867415-project Jun 20 15:04:07.332230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 15:04:07.332230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. Jun 20 15:04:07.332230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '1d7eb8d0-d6c0-4416-9d51-b8e7c732800e'} Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 15:04:07.333323 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. Jun 20 15:04:07.334828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:04:07.336209 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-b3a5c906-06c3-4051-8970-eddbf32b139e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] Returning 404 to user: Instance 1d7eb8d0-d6c0-4416-9d51-b8e7c732800e could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 15:04:07.336209 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-b3a5c906-06c3-4051-8970-eddbf32b139e tempest-AttachVolumeTestJSON-1867415 tempest-AttachVolumeTestJSON-1867415-project] 10.222.0.23 "GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e" status: 404 len: 111 microversion: 2.1 time: 0.032870 Jun 20 15:04:07.336209 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 507/995] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:04:07 2022] GET /compute/v2.1/servers/1d7eb8d0-d6c0-4416-9d51-b8e7c732800e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 15:04:21.433820 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-7fe08ef1-560a-4261-ad4d-fac744924c96 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:04:21.434388 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7fe08ef1-560a-4261-ad4d-fac744924c96 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:04:21.438070 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:21.439772 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:21.440983 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=22 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:21.441954 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:21.443783 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7fe08ef1-560a-4261-ad4d-fac744924c96 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:21.444447 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7fe08ef1-560a-4261-ad4d-fac744924c96 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:21.454009 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7fe08ef1-560a-4261-ad4d-fac744924c96 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:21.456812 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-7fe08ef1-560a-4261-ad4d-fac744924c96 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:21.485119 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-7fe08ef1-560a-4261-ad4d-fac744924c96 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 15:04:21.571221 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-7fe08ef1-560a-4261-ad4d-fac744924c96 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "DELETE /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 204 len: 0 microversion: 2.1 time: 0.141487 Jun 20 15:04:21.576840 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 489/996] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 15:04:21 2022] DELETE /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 15:04:21.578851 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-59953744-0338-481b-8751-8fd8e76216cc req-0d681914-2bc3-417f-a0f0-9d3519e1756d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f9ab17-ba92-425c-b79e-ace0b9666352", "tag": "39c85ef4-03a3-4009-bf95-8bd7df3230ea"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:04:21.582622 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-4ee566da-a665-47ed-9c19-9ce87b946ebc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:04:21.583332 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-4ee566da-a665-47ed-9c19-9ce87b946ebc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:04:21.589269 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-59953744-0338-481b-8751-8fd8e76216cc req-0d681914-2bc3-417f-a0f0-9d3519e1756d service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:21.589703 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-59953744-0338-481b-8751-8fd8e76216cc req-0d681914-2bc3-417f-a0f0-9d3519e1756d service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:21.590383 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4ee566da-a665-47ed-9c19-9ce87b946ebc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:21.590841 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4ee566da-a665-47ed-9c19-9ce87b946ebc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:21.591613 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4ee566da-a665-47ed-9c19-9ce87b946ebc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:21.592045 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-4ee566da-a665-47ed-9c19-9ce87b946ebc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:21.601366 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-59953744-0338-481b-8751-8fd8e76216cc req-0d681914-2bc3-417f-a0f0-9d3519e1756d service nova] Creating event network-changed:39c85ef4-03a3-4009-bf95-8bd7df3230ea for instance 69f9ab17-ba92-425c-b79e-ace0b9666352 on hv-cinder-83697 Jun 20 15:04:21.607108 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-59953744-0338-481b-8751-8fd8e76216cc req-0d681914-2bc3-417f-a0f0-9d3519e1756d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175302 Jun 20 15:04:21.607749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 508/997] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:04:21.726454 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-4ee566da-a665-47ed-9c19-9ce87b946ebc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:04:21.734647 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-4ee566da-a665-47ed-9c19-9ce87b946ebc tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1570 microversion: 2.1 time: 0.156498 Jun 20 15:04:21.736758 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 490/998] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:04:21 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:04:22.755311 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-9bbf0444-9082-4fc1-a200-c35e06bbd2ee tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:04:22.755944 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-9bbf0444-9082-4fc1-a200-c35e06bbd2ee tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:04:22.763364 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9bbf0444-9082-4fc1-a200-c35e06bbd2ee tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:22.763807 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9bbf0444-9082-4fc1-a200-c35e06bbd2ee tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:22.764569 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9bbf0444-9082-4fc1-a200-c35e06bbd2ee tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:22.765016 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-9bbf0444-9082-4fc1-a200-c35e06bbd2ee tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:22.923065 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-9bbf0444-9082-4fc1-a200-c35e06bbd2ee tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:04:22.936393 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-9bbf0444-9082-4fc1-a200-c35e06bbd2ee tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1570 microversion: 2.1 time: 0.185472 Jun 20 15:04:22.937113 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 509/999] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:04:22 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:04:23.968855 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-70ef85a5-7737-47be-b3cc-a1602c86524e tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:04:23.968855 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-70ef85a5-7737-47be-b3cc-a1602c86524e tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:04:23.973429 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-70ef85a5-7737-47be-b3cc-a1602c86524e tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:23.973962 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-70ef85a5-7737-47be-b3cc-a1602c86524e tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:23.974824 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-70ef85a5-7737-47be-b3cc-a1602c86524e tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:23.975295 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-70ef85a5-7737-47be-b3cc-a1602c86524e tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:24.128878 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-70ef85a5-7737-47be-b3cc-a1602c86524e tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:04:24.136758 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-70ef85a5-7737-47be-b3cc-a1602c86524e tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1570 microversion: 2.1 time: 0.177343 Jun 20 15:04:24.137361 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 491/1000] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:04:23 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:04:25.154439 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-ba651842-56cc-44a7-bc6a-352cb53825a8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:04:25.155275 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-ba651842-56cc-44a7-bc6a-352cb53825a8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:04:25.165788 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba651842-56cc-44a7-bc6a-352cb53825a8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:25.166522 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba651842-56cc-44a7-bc6a-352cb53825a8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:25.167459 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba651842-56cc-44a7-bc6a-352cb53825a8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:25.168040 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-ba651842-56cc-44a7-bc6a-352cb53825a8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:25.386821 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-ba651842-56cc-44a7-bc6a-352cb53825a8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5422c53c285f4e33998f7aabe528750c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cab4870474548b98c3a81a3aa8031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:04:25.394755 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-ba651842-56cc-44a7-bc6a-352cb53825a8 tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 200 len: 1570 microversion: 2.1 time: 0.244281 Jun 20 15:04:25.395620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 510/1001] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:04:25 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 1570 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 15:04:25.608027 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-c9688064-0b41-42cd-89e1-73a6b4fbb405 req-fea40ac2-5e7a-4540-a443-78fbbf72cc70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f9ab17-ba92-425c-b79e-ace0b9666352", "name": "network-vif-deleted", "tag": "39c85ef4-03a3-4009-bf95-8bd7df3230ea"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:04:25.617271 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-c9688064-0b41-42cd-89e1-73a6b4fbb405 req-fea40ac2-5e7a-4540-a443-78fbbf72cc70 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:25.618511 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-c9688064-0b41-42cd-89e1-73a6b4fbb405 req-fea40ac2-5e7a-4540-a443-78fbbf72cc70 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:25.630750 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-c9688064-0b41-42cd-89e1-73a6b4fbb405 req-fea40ac2-5e7a-4540-a443-78fbbf72cc70 service nova] Creating event network-vif-deleted:39c85ef4-03a3-4009-bf95-8bd7df3230ea for instance 69f9ab17-ba92-425c-b79e-ace0b9666352 on hv-cinder-83697 Jun 20 15:04:25.636801 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-c9688064-0b41-42cd-89e1-73a6b4fbb405 req-fea40ac2-5e7a-4540-a443-78fbbf72cc70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032773 Jun 20 15:04:25.637414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 492/1002] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:04:26.412313 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-51094f9e-8fbd-4b25-9739-f523c6109baa tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:04:26.413071 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-51094f9e-8fbd-4b25-9739-f523c6109baa tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] [instance: 69f9ab17-ba92-425c-b79e-ace0b9666352] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:04:26.419598 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-51094f9e-8fbd-4b25-9739-f523c6109baa tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:26.420089 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-51094f9e-8fbd-4b25-9739-f523c6109baa tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:26.420978 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-51094f9e-8fbd-4b25-9739-f523c6109baa tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:04:26.421417 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-51094f9e-8fbd-4b25-9739-f523c6109baa tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:04:26.436115 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.wsgi [None req-51094f9e-8fbd-4b25-9739-f523c6109baa tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] HTTP exception thrown: Instance 69f9ab17-ba92-425c-b79e-ace0b9666352 could not be found. Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-51094f9e-8fbd-4b25-9739-f523c6109baa tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Request method failure captured: Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: request: GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 HTTP/1.1 Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept: application/json Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Accept-Encoding: identity Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Connection: close Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Length: 0 Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Content-Type: application/json Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Host: 10.222.0.23 Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Openstack-System-Scope: None Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: User-Agent: python-urllib3/1.26.9 Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Auth-Token: gAAAAABisItsVcJHIOsJb8OYj17TxACkZuVouGYubnoqvv45BZSC_47_tYxzaF-ivfo2DZbBW0aV3kPrkiW8KgnyOzQrvUwn-lnFS3v1qu5HPblW0lrYWDxLpnaOgFRRgpd8ao0rHhVDYLRRzCsw76B3aR73m72RluE2UWREYYN2dEuwvci7Dho Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Id: None Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Domain-Name: None Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Identity-Status: Confirmed Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Is-Admin-Project: True Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Id: default Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Domain-Name: Default Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Id: f29cab4870474548b98c3a81a3aa8031 Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Project-Name: tempest-TestShelveInstance-260618824 Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Role: member,reader Jun 20 15:04:26.437763 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Roles: member,reader Jun 20 15:04:26.439308 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f29cab4870474548b98c3a81a3aa8031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f29cab4870474548b98c3a81a3aa8031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f29cab4870474548b98c3a81a3aa8031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f29cab4870474548b98c3a81a3aa8031"}]}] Jun 20 15:04:26.439308 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant: tempest-TestShelveInstance-260618824 Jun 20 15:04:26.439308 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Id: f29cab4870474548b98c3a81a3aa8031 Jun 20 15:04:26.439308 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-Tenant-Name: tempest-TestShelveInstance-260618824 Jun 20 15:04:26.439308 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User: tempest-TestShelveInstance-260618824-project Jun 20 15:04:26.439308 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Id: default Jun 20 15:04:26.439308 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Domain-Name: Default Jun 20 15:04:26.439308 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Id: 5422c53c285f4e33998f7aabe528750c Jun 20 15:04:26.439308 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: X-User-Name: tempest-TestShelveInstance-260618824-project Jun 20 15:04:26.439308 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: method: > Jun 20 15:04:26.439308 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: exception: Instance 69f9ab17-ba92-425c-b79e-ace0b9666352 could not be found. Jun 20 15:04:26.439308 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: action_args: {'id': '69f9ab17-ba92-425c-b79e-ace0b9666352'} Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f9ab17-ba92-425c-b79e-ace0b9666352 could not be found. Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 15:04:26.440223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f9ab17-ba92-425c-b79e-ace0b9666352 could not be found. Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f9ab17-ba92-425c-b79e-ace0b9666352 could not be found. Jun 20 15:04:26.441620 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: ERROR nova.api.openstack.wsgi Jun 20 15:04:26.442836 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-51094f9e-8fbd-4b25-9739-f523c6109baa tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Returning 404 to user: Instance 69f9ab17-ba92-425c-b79e-ace0b9666352 could not be found. {{(pid=123979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 15:04:26.442836 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-51094f9e-8fbd-4b25-9739-f523c6109baa tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352" status: 404 len: 111 microversion: 2.1 time: 0.034431 Jun 20 15:04:26.443813 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 511/1003] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:04:26 2022] GET /compute/v2.1/servers/69f9ab17-ba92-425c-b79e-ace0b9666352 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 15:04:26.627024 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2804c794-cb75-487b-a58a-ba8b78f2119f tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] Calling method '.version_select at 0x7fce50972c10>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:04:26.648556 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2804c794-cb75-487b-a58a-ba8b78f2119f tempest-TestShelveInstance-260618824 tempest-TestShelveInstance-260618824-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1858792678" status: 202 len: 0 microversion: 2.1 time: 0.026472 Jun 20 15:04:26.649551 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 493/1004] 10.222.0.23 () {58 vars in 1253 bytes} [Mon Jun 20 15:04:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1858792678 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 15:05:06.082304 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1423627822", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "networks": [{"uuid": "d8ca2f92-4420-4b60-ac38-63d7edea8687"}]}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:05:06.089561 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=8 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:06.090189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=16 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:06.148911 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.network.neutron [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] validate_networks() for [('d8ca2f92-4420-4b60-ac38-63d7edea8687', None, None, None, None, None)] {{(pid=123979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 15:05:06.549535 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Flavor limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 15:05:06.550106 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Image limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 15:05:06.550574 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Flavor pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 15:05:06.550974 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Image pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 15:05:06.551381 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 15:05:06.561278 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:06.561721 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:06.562504 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:06.562929 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:06.580596 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Getting quotas for project 655fee4df800492ca9507af988943721. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 15:05:06.585104 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Getting quotas for user 2365819f6b8d4c0e83db04d90e710969 and project 655fee4df800492ca9507af988943721. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 15:05:06.597433 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Going to run 1 instances... {{(pid=123979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 15:05:06.599719 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 15:05:06.654725 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-c42c0196-d9b1-4516-b760-3144dc4d6f8c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576276 Jun 20 15:05:06.655376 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 512/1005] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 15:05:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 15:05:06.666077 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1c57d0a3-f884-4eb9-ab7b-97e35d20d22f tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:05:06.666859 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1c57d0a3-f884-4eb9-ab7b-97e35d20d22f tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:06.669325 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:06.670075 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:06.731643 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1c57d0a3-f884-4eb9-ab7b-97e35d20d22f tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:05:06.739302 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1c57d0a3-f884-4eb9-ab7b-97e35d20d22f tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3" status: 200 len: 1219 microversion: 2.1 time: 0.077601 Jun 20 15:05:06.739856 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 494/1006] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:05:06 2022] GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:05:07.756182 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-38987f17-4d0e-43d6-a836-e45e2d2edd4e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:05:07.756828 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-38987f17-4d0e-43d6-a836-e45e2d2edd4e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:07.764503 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-38987f17-4d0e-43d6-a836-e45e2d2edd4e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:07.765100 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-38987f17-4d0e-43d6-a836-e45e2d2edd4e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:07.765955 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-38987f17-4d0e-43d6-a836-e45e2d2edd4e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:07.766386 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-38987f17-4d0e-43d6-a836-e45e2d2edd4e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:07.833377 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-38987f17-4d0e-43d6-a836-e45e2d2edd4e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:05:07.842771 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-38987f17-4d0e-43d6-a836-e45e2d2edd4e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3" status: 200 len: 1279 microversion: 2.1 time: 0.091105 Jun 20 15:05:07.843380 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 513/1007] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:05:07 2022] GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3 => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:05:08.862365 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-fa671a48-cb91-421a-84d8-67f3bf23b237 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:05:08.863073 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-fa671a48-cb91-421a-84d8-67f3bf23b237 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:08.870607 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fa671a48-cb91-421a-84d8-67f3bf23b237 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:08.871090 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fa671a48-cb91-421a-84d8-67f3bf23b237 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:08.871864 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fa671a48-cb91-421a-84d8-67f3bf23b237 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:08.872290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-fa671a48-cb91-421a-84d8-67f3bf23b237 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:09.050527 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-fa671a48-cb91-421a-84d8-67f3bf23b237 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:05:09.058716 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-fa671a48-cb91-421a-84d8-67f3bf23b237 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3" status: 200 len: 1319 microversion: 2.1 time: 0.200502 Jun 20 15:05:09.059300 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 495/1008] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:05:08 2022] GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:05:09.129180 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-75f4bcd9-5a29-4b18-a4b7-384b45a78315 req-ed2cf5f3-233e-4c68-9a8e-0a3973b96644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0ba852-dabf-49d1-8fe6-3e7932484da3", "tag": "a1cfd00d-792d-4a57-b492-4bab4745de91"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:05:09.139223 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-75f4bcd9-5a29-4b18-a4b7-384b45a78315 req-ed2cf5f3-233e-4c68-9a8e-0a3973b96644 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:09.139734 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-75f4bcd9-5a29-4b18-a4b7-384b45a78315 req-ed2cf5f3-233e-4c68-9a8e-0a3973b96644 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:09.151878 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-75f4bcd9-5a29-4b18-a4b7-384b45a78315 req-ed2cf5f3-233e-4c68-9a8e-0a3973b96644 service nova] Creating event network-changed:a1cfd00d-792d-4a57-b492-4bab4745de91 for instance cc0ba852-dabf-49d1-8fe6-3e7932484da3 on hv-cinder-83697 Jun 20 15:05:09.156992 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-75f4bcd9-5a29-4b18-a4b7-384b45a78315 req-ed2cf5f3-233e-4c68-9a8e-0a3973b96644 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031469 Jun 20 15:05:09.157594 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 514/1009] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:05:10.080158 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-eb1169a3-d585-4dce-856a-c1aa00106e33 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:05:10.081275 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-eb1169a3-d585-4dce-856a-c1aa00106e33 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:10.091858 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eb1169a3-d585-4dce-856a-c1aa00106e33 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:10.092529 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eb1169a3-d585-4dce-856a-c1aa00106e33 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:10.093728 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eb1169a3-d585-4dce-856a-c1aa00106e33 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:10.094382 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eb1169a3-d585-4dce-856a-c1aa00106e33 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:10.229094 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-eb1169a3-d585-4dce-856a-c1aa00106e33 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:05:10.236682 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-eb1169a3-d585-4dce-856a-c1aa00106e33 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3" status: 200 len: 1319 microversion: 2.1 time: 0.162589 Jun 20 15:05:10.237305 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 496/1010] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:05:10 2022] GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:05:11.255873 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-687b7c29-428d-4bda-80a2-35c36741a22d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:05:11.256701 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-687b7c29-428d-4bda-80a2-35c36741a22d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:11.264608 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-687b7c29-428d-4bda-80a2-35c36741a22d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:11.265152 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-687b7c29-428d-4bda-80a2-35c36741a22d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:11.266063 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-687b7c29-428d-4bda-80a2-35c36741a22d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:11.266584 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-687b7c29-428d-4bda-80a2-35c36741a22d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:11.411554 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-687b7c29-428d-4bda-80a2-35c36741a22d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:05:11.420688 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-687b7c29-428d-4bda-80a2-35c36741a22d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3" status: 200 len: 1319 microversion: 2.1 time: 0.170477 Jun 20 15:05:11.421285 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 515/1011] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:05:11 2022] GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:05:12.438118 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-516df04f-5785-455f-8a82-7a505ee55ab0 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:05:12.439385 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-516df04f-5785-455f-8a82-7a505ee55ab0 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:12.446265 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-516df04f-5785-455f-8a82-7a505ee55ab0 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:12.446770 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-516df04f-5785-455f-8a82-7a505ee55ab0 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:12.447541 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-516df04f-5785-455f-8a82-7a505ee55ab0 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:12.447972 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-516df04f-5785-455f-8a82-7a505ee55ab0 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:12.578577 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-516df04f-5785-455f-8a82-7a505ee55ab0 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:05:12.586332 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-516df04f-5785-455f-8a82-7a505ee55ab0 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3" status: 200 len: 1319 microversion: 2.1 time: 0.152285 Jun 20 15:05:12.586930 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 497/1012] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:05:12 2022] GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 15:05:13.603886 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-1e93f7d3-8481-49e8-bbc5-39edf136695a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:05:13.604568 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-1e93f7d3-8481-49e8-bbc5-39edf136695a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:13.612048 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1e93f7d3-8481-49e8-bbc5-39edf136695a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:13.612538 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1e93f7d3-8481-49e8-bbc5-39edf136695a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:13.613394 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1e93f7d3-8481-49e8-bbc5-39edf136695a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:13.613877 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-1e93f7d3-8481-49e8-bbc5-39edf136695a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:13.742376 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-1e93f7d3-8481-49e8-bbc5-39edf136695a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:05:13.750367 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-1e93f7d3-8481-49e8-bbc5-39edf136695a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3" status: 200 len: 1319 microversion: 2.1 time: 0.150946 Jun 20 15:05:13.750974 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 516/1013] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:05:13 2022] GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:05:14.387403 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-50d1d49b-7433-4a82-9e5c-ed5d9f271a9c req-72149bd3-e6c9-4ca1-b2a4-df748092018c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0ba852-dabf-49d1-8fe6-3e7932484da3", "name": "network-vif-plugged", "status": "completed", "tag": "a1cfd00d-792d-4a57-b492-4bab4745de91"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:05:14.395565 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-50d1d49b-7433-4a82-9e5c-ed5d9f271a9c req-72149bd3-e6c9-4ca1-b2a4-df748092018c service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:14.395997 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-50d1d49b-7433-4a82-9e5c-ed5d9f271a9c req-72149bd3-e6c9-4ca1-b2a4-df748092018c service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:14.407133 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-50d1d49b-7433-4a82-9e5c-ed5d9f271a9c req-72149bd3-e6c9-4ca1-b2a4-df748092018c service nova] Creating event network-vif-plugged:a1cfd00d-792d-4a57-b492-4bab4745de91 for instance cc0ba852-dabf-49d1-8fe6-3e7932484da3 on hv-cinder-83697 Jun 20 15:05:14.412097 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-50d1d49b-7433-4a82-9e5c-ed5d9f271a9c req-72149bd3-e6c9-4ca1-b2a4-df748092018c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150741 Jun 20 15:05:14.412669 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 498/1014] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:05:14.771556 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-e2196906-521a-406a-8fe7-cc8c5ab56ef7 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:05:14.772811 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-e2196906-521a-406a-8fe7-cc8c5ab56ef7 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:14.780985 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e2196906-521a-406a-8fe7-cc8c5ab56ef7 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:14.782337 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e2196906-521a-406a-8fe7-cc8c5ab56ef7 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:14.783300 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e2196906-521a-406a-8fe7-cc8c5ab56ef7 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:14.783890 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-e2196906-521a-406a-8fe7-cc8c5ab56ef7 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:14.935495 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-e2196906-521a-406a-8fe7-cc8c5ab56ef7 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:05:14.946818 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-e2196906-521a-406a-8fe7-cc8c5ab56ef7 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3" status: 200 len: 1319 microversion: 2.1 time: 0.179259 Jun 20 15:05:14.947520 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 517/1015] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:05:14 2022] GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:05:15.973811 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-1a490aea-29bb-4c93-9694-90460cafc0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:05:15.975281 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-1a490aea-29bb-4c93-9694-90460cafc0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:15.982723 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1a490aea-29bb-4c93-9694-90460cafc0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:15.983164 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1a490aea-29bb-4c93-9694-90460cafc0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:15.983926 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1a490aea-29bb-4c93-9694-90460cafc0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:15.984360 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-1a490aea-29bb-4c93-9694-90460cafc0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:16.121659 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-1a490aea-29bb-4c93-9694-90460cafc0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:05:16.129683 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-1a490aea-29bb-4c93-9694-90460cafc0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3" status: 200 len: 1319 microversion: 2.1 time: 0.163598 Jun 20 15:05:16.130204 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 499/1016] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:05:15 2022] GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:05:17.150933 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-5aac6991-e7b0-4a21-8594-c04f0fec7004 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:05:17.151543 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-5aac6991-e7b0-4a21-8594-c04f0fec7004 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:17.154066 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:17.154669 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=6 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:17.163427 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5aac6991-e7b0-4a21-8594-c04f0fec7004 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:17.164041 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5aac6991-e7b0-4a21-8594-c04f0fec7004 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:17.165185 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5aac6991-e7b0-4a21-8594-c04f0fec7004 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:17.165681 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-5aac6991-e7b0-4a21-8594-c04f0fec7004 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:17.297093 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-5aac6991-e7b0-4a21-8594-c04f0fec7004 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:05:17.304702 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-5aac6991-e7b0-4a21-8594-c04f0fec7004 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3" status: 200 len: 1507 microversion: 2.1 time: 0.159870 Jun 20 15:05:17.305295 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 518/1017] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:05:17 2022] GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:05:31.452112 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-d9de4feb-7ad2-4b1c-91e0-b89ea0ce6134 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "570ccb57-02b2-4f26-a66b-1ded97633a84", "device": "/dev/sdb"}} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:05:31.453806 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-d9de4feb-7ad2-4b1c-91e0-b89ea0ce6134 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:31.456147 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:31.457076 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=14 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:31.457602 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=26 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:31.463726 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d9de4feb-7ad2-4b1c-91e0-b89ea0ce6134 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:31.464342 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d9de4feb-7ad2-4b1c-91e0-b89ea0ce6134 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:31.465128 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d9de4feb-7ad2-4b1c-91e0-b89ea0ce6134 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:31.465672 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-d9de4feb-7ad2-4b1c-91e0-b89ea0ce6134 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:31.728845 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-d9de4feb-7ad2-4b1c-91e0-b89ea0ce6134 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "POST /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280640 Jun 20 15:05:31.729512 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 500/1018] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 15:05:31 2022] POST /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:05:39.202015 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 15:05:39.203046 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Mon Jun 20 15:05:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 15:05:51.406394 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-305b03b0-e979-4c8b-ae87-8fbe59546c88 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:05:51.406965 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-305b03b0-e979-4c8b-ae87-8fbe59546c88 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:51.409170 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:51.409923 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=34 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:51.415970 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-305b03b0-e979-4c8b-ae87-8fbe59546c88 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:51.416415 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-305b03b0-e979-4c8b-ae87-8fbe59546c88 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:51.417195 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-305b03b0-e979-4c8b-ae87-8fbe59546c88 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:51.417622 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-305b03b0-e979-4c8b-ae87-8fbe59546c88 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:51.505310 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.objects.instance [None req-305b03b0-e979-4c8b-ae87-8fbe59546c88 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lazy-loading 'services' on Instance uuid cc0ba852-dabf-49d1-8fe6-3e7932484da3 {{(pid=123979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 15:05:51.583912 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-305b03b0-e979-4c8b-ae87-8fbe59546c88 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3/os-volume_attachments/570ccb57-02b2-4f26-a66b-1ded97633a84" status: 202 len: 0 microversion: 2.1 time: 0.181914 Jun 20 15:05:51.584735 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 519/1019] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 15:05:51 2022] DELETE /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3/os-volume_attachments/570ccb57-02b2-4f26-a66b-1ded97633a84 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 15:05:52.706189 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:52.707397 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:52.711503 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e15537e2-4c6d-43e5-ad5c-c77875239ba5 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:05:52.712091 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e15537e2-4c6d-43e5-ad5c-c77875239ba5 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:52.720072 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e15537e2-4c6d-43e5-ad5c-c77875239ba5 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:52.720510 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e15537e2-4c6d-43e5-ad5c-c77875239ba5 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:52.721333 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e15537e2-4c6d-43e5-ad5c-c77875239ba5 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:52.721761 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e15537e2-4c6d-43e5-ad5c-c77875239ba5 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:52.747051 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e15537e2-4c6d-43e5-ad5c-c77875239ba5 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Going to try to terminate instance {{(pid=123978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 15:05:52.833985 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e15537e2-4c6d-43e5-ad5c-c77875239ba5 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3" status: 204 len: 0 microversion: 2.1 time: 0.128674 Jun 20 15:05:52.834688 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 501/1020] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 15:05:52 2022] DELETE /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 15:05:52.843982 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-d82a60c9-3712-482f-b07c-a7a6755b0549 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:05:52.844669 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-d82a60c9-3712-482f-b07c-a7a6755b0549 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:52.851543 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d82a60c9-3712-482f-b07c-a7a6755b0549 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:52.851981 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d82a60c9-3712-482f-b07c-a7a6755b0549 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:52.852749 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d82a60c9-3712-482f-b07c-a7a6755b0549 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:52.853183 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-d82a60c9-3712-482f-b07c-a7a6755b0549 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:52.988381 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-d82a60c9-3712-482f-b07c-a7a6755b0549 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:05:53.000430 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-d82a60c9-3712-482f-b07c-a7a6755b0549 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3" status: 200 len: 1513 microversion: 2.1 time: 0.160437 Jun 20 15:05:53.001313 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 520/1021] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:05:52 2022] GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:05:54.020189 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ce0dea7e-5959-45d1-ac1f-74e67a881f9b tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:05:54.020915 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ce0dea7e-5959-45d1-ac1f-74e67a881f9b tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:54.027916 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ce0dea7e-5959-45d1-ac1f-74e67a881f9b tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:54.028368 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ce0dea7e-5959-45d1-ac1f-74e67a881f9b tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:54.029258 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ce0dea7e-5959-45d1-ac1f-74e67a881f9b tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:54.029648 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ce0dea7e-5959-45d1-ac1f-74e67a881f9b tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:54.423532 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ce0dea7e-5959-45d1-ac1f-74e67a881f9b tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:05:54.431926 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ce0dea7e-5959-45d1-ac1f-74e67a881f9b tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3" status: 200 len: 1513 microversion: 2.1 time: 0.416089 Jun 20 15:05:54.432496 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 502/1022] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:05:54 2022] GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3 => generated 1513 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:05:54.874596 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-a32def12-b2c7-4e58-9652-aea50f54d66d req-240a02f0-a00b-4d64-8b11-804959a72df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0ba852-dabf-49d1-8fe6-3e7932484da3", "name": "network-vif-deleted", "tag": "a1cfd00d-792d-4a57-b492-4bab4745de91"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:05:54.886704 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-a32def12-b2c7-4e58-9652-aea50f54d66d req-240a02f0-a00b-4d64-8b11-804959a72df0 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:54.887206 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-a32def12-b2c7-4e58-9652-aea50f54d66d req-240a02f0-a00b-4d64-8b11-804959a72df0 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:54.899856 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-a32def12-b2c7-4e58-9652-aea50f54d66d req-240a02f0-a00b-4d64-8b11-804959a72df0 service nova] Creating event network-vif-deleted:a1cfd00d-792d-4a57-b492-4bab4745de91 for instance cc0ba852-dabf-49d1-8fe6-3e7932484da3 on hv-cinder-83697 Jun 20 15:05:54.904822 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-a32def12-b2c7-4e58-9652-aea50f54d66d req-240a02f0-a00b-4d64-8b11-804959a72df0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034944 Jun 20 15:05:54.905451 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 521/1023] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:05:55.450035 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2893ebfa-ccea-4570-a4b5-2fbab1b5e532 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:05:55.450713 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2893ebfa-ccea-4570-a4b5-2fbab1b5e532 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: cc0ba852-dabf-49d1-8fe6-3e7932484da3] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:05:55.458625 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2893ebfa-ccea-4570-a4b5-2fbab1b5e532 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:55.459122 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2893ebfa-ccea-4570-a4b5-2fbab1b5e532 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:55.459965 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2893ebfa-ccea-4570-a4b5-2fbab1b5e532 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:05:55.460427 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2893ebfa-ccea-4570-a4b5-2fbab1b5e532 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:05:55.475008 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-2893ebfa-ccea-4570-a4b5-2fbab1b5e532 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] HTTP exception thrown: Instance cc0ba852-dabf-49d1-8fe6-3e7932484da3 could not be found. Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2893ebfa-ccea-4570-a4b5-2fbab1b5e532 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Request method failure captured: Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3 HTTP/1.1 Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisIyg-vljzbmcKVpfVikrqsULepqRYeP5hWtW3YS8K9ph0aEtCymTYPcyYkf0QMblJcsoOuF4kA5VhI0gKtkhY35Czt7A_bBbEt3otC23_SNnfwSLPsMi9BfyT_Zcv1xcyvmZM-raqLWvdCCwMItIahtF251iacZpFpgcoKmWJ2f3w1c Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: 655fee4df800492ca9507af988943721 Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-VolumesSnapshotTestJSON-537331159 Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 15:05:55.476615 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 15:05:55.478171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_655fee4df800492ca9507af988943721"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/655fee4df800492ca9507af988943721"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/655fee4df800492ca9507af988943721"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/655fee4df800492ca9507af988943721"}]}] Jun 20 15:05:55.478171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-VolumesSnapshotTestJSON-537331159 Jun 20 15:05:55.478171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: 655fee4df800492ca9507af988943721 Jun 20 15:05:55.478171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-537331159 Jun 20 15:05:55.478171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-VolumesSnapshotTestJSON-537331159-project Jun 20 15:05:55.478171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 15:05:55.478171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 15:05:55.478171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 2365819f6b8d4c0e83db04d90e710969 Jun 20 15:05:55.478171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-VolumesSnapshotTestJSON-537331159-project Jun 20 15:05:55.478171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 15:05:55.478171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance cc0ba852-dabf-49d1-8fe6-3e7932484da3 could not be found. Jun 20 15:05:55.478171 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': 'cc0ba852-dabf-49d1-8fe6-3e7932484da3'} Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc0ba852-dabf-49d1-8fe6-3e7932484da3 could not be found. Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 15:05:55.479023 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc0ba852-dabf-49d1-8fe6-3e7932484da3 could not be found. Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc0ba852-dabf-49d1-8fe6-3e7932484da3 could not be found. Jun 20 15:05:55.480414 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:05:55.482096 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2893ebfa-ccea-4570-a4b5-2fbab1b5e532 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Returning 404 to user: Instance cc0ba852-dabf-49d1-8fe6-3e7932484da3 could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 15:05:55.482096 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2893ebfa-ccea-4570-a4b5-2fbab1b5e532 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3" status: 404 len: 111 microversion: 2.1 time: 0.032447 Jun 20 15:05:55.482096 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 503/1024] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:05:55 2022] GET /compute/v2.1/servers/cc0ba852-dabf-49d1-8fe6-3e7932484da3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 15:06:03.323989 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1613066137", "imageRef": "21230212-9b17-4cde-8917-bd6f526585f0", "flavorRef": "452", "networks": [{"uuid": "d8ca2f92-4420-4b60-ac38-63d7edea8687"}]}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:06:03.381153 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.network.neutron [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] validate_networks() for [('d8ca2f92-4420-4b60-ac38-63d7edea8687', None, None, None, None, None)] {{(pid=123979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 15:06:03.728653 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Flavor limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 15:06:03.729230 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Image limits 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 15:06:03.729844 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Flavor pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 15:06:03.730375 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Image pref 0:0:0 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 15:06:03.730929 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.virt.hardware [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 15:06:03.745784 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:03.746397 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:03.747599 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:03.748205 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:03.765447 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Getting quotas for project 655fee4df800492ca9507af988943721. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 15:06:03.769668 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.quota [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Getting quotas for user 2365819f6b8d4c0e83db04d90e710969 and project 655fee4df800492ca9507af988943721. Resources: {'cores', 'instances', 'ram'} {{(pid=123979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 15:06:03.781771 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Going to run 1 instances... {{(pid=123979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 15:06:03.784350 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21230212-9b17-4cde-8917-bd6f526585f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 15:06:03.830482 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-81ffd2ab-730d-4343-aa3d-72ae92f92a57 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511316 Jun 20 15:06:03.831106 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 522/1025] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Jun 20 15:06:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 15:06:03.843913 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-038b3449-5790-4c3c-8616-61ed57bce6f6 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:03.844678 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-038b3449-5790-4c3c-8616-61ed57bce6f6 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:03.902953 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-038b3449-5790-4c3c-8616-61ed57bce6f6 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:06:03.909734 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-038b3449-5790-4c3c-8616-61ed57bce6f6 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69" status: 200 len: 1219 microversion: 2.1 time: 0.070859 Jun 20 15:06:03.910717 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 504/1026] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:06:03 2022] GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:06:04.926473 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-dc34bafc-562a-4c4a-962d-636d09da3d09 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:04.927160 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-dc34bafc-562a-4c4a-962d-636d09da3d09 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:04.937730 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dc34bafc-562a-4c4a-962d-636d09da3d09 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:04.938189 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dc34bafc-562a-4c4a-962d-636d09da3d09 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:04.939054 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dc34bafc-562a-4c4a-962d-636d09da3d09 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:04.939631 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-dc34bafc-562a-4c4a-962d-636d09da3d09 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:05.012289 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-dc34bafc-562a-4c4a-962d-636d09da3d09 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:06:05.021124 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-dc34bafc-562a-4c4a-962d-636d09da3d09 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69" status: 200 len: 1277 microversion: 2.1 time: 0.098875 Jun 20 15:06:05.021899 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 523/1027] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:06:04 2022] GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:06:06.038793 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-ca8dfec2-cf7e-40ec-9e38-3218a3c0155d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:06.039411 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-ca8dfec2-cf7e-40ec-9e38-3218a3c0155d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:06.041958 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:06:06.048603 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ca8dfec2-cf7e-40ec-9e38-3218a3c0155d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:06.049083 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ca8dfec2-cf7e-40ec-9e38-3218a3c0155d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:06.049861 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ca8dfec2-cf7e-40ec-9e38-3218a3c0155d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:06.050293 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-ca8dfec2-cf7e-40ec-9e38-3218a3c0155d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:06.142529 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [req-f9473b50-37d8-4aa5-8844-a50dd8016b68 req-52482bbb-e98f-4a2a-879b-9e69a2a320b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df1ce8f7-7ca4-4277-af4c-4884f6aa8c69", "tag": "ec8e2a94-131d-4419-b6e2-7aaf73cd99e3"}]} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:06:06.154654 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-f9473b50-37d8-4aa5-8844-a50dd8016b68 req-52482bbb-e98f-4a2a-879b-9e69a2a320b9 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:06.155026 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [req-f9473b50-37d8-4aa5-8844-a50dd8016b68 req-52482bbb-e98f-4a2a-879b-9e69a2a320b9 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:06.167687 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.compute.server_external_events [req-f9473b50-37d8-4aa5-8844-a50dd8016b68 req-52482bbb-e98f-4a2a-879b-9e69a2a320b9 service nova] Creating event network-changed:ec8e2a94-131d-4419-b6e2-7aaf73cd99e3 for instance df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 on hv-cinder-83697 Jun 20 15:06:06.173646 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [req-f9473b50-37d8-4aa5-8844-a50dd8016b68 req-52482bbb-e98f-4a2a-879b-9e69a2a320b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035209 Jun 20 15:06:06.174262 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 524/1028] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:06:06.252113 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-ca8dfec2-cf7e-40ec-9e38-3218a3c0155d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:06:06.260586 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-ca8dfec2-cf7e-40ec-9e38-3218a3c0155d tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69" status: 200 len: 1319 microversion: 2.1 time: 0.225688 Jun 20 15:06:06.261240 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 505/1029] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:06:06 2022] GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:06:07.282469 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-6885cc09-9610-432d-9128-97e966386d04 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:07.283769 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-6885cc09-9610-432d-9128-97e966386d04 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:07.290831 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6885cc09-9610-432d-9128-97e966386d04 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:07.291271 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6885cc09-9610-432d-9128-97e966386d04 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:07.292036 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6885cc09-9610-432d-9128-97e966386d04 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:07.292463 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-6885cc09-9610-432d-9128-97e966386d04 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:07.425319 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-6885cc09-9610-432d-9128-97e966386d04 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:06:07.433549 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-6885cc09-9610-432d-9128-97e966386d04 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69" status: 200 len: 1319 microversion: 2.1 time: 0.158083 Jun 20 15:06:07.434330 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 525/1030] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:06:07 2022] GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:06:08.450932 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-e988f87c-bfcb-4966-a1b4-e8c3c54bead2 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:08.451567 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-e988f87c-bfcb-4966-a1b4-e8c3c54bead2 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:08.458913 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e988f87c-bfcb-4966-a1b4-e8c3c54bead2 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:08.459353 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e988f87c-bfcb-4966-a1b4-e8c3c54bead2 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:08.460106 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e988f87c-bfcb-4966-a1b4-e8c3c54bead2 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:08.460534 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-e988f87c-bfcb-4966-a1b4-e8c3c54bead2 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:08.593354 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-e988f87c-bfcb-4966-a1b4-e8c3c54bead2 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:06:08.605567 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-e988f87c-bfcb-4966-a1b4-e8c3c54bead2 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69" status: 200 len: 1319 microversion: 2.1 time: 0.158494 Jun 20 15:06:08.606122 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 506/1031] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:06:08 2022] GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:06:09.628078 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-4fc764c0-6c7e-4525-a554-f347fabf3ca4 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:09.628693 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-4fc764c0-6c7e-4525-a554-f347fabf3ca4 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:09.635898 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4fc764c0-6c7e-4525-a554-f347fabf3ca4 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:09.636345 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4fc764c0-6c7e-4525-a554-f347fabf3ca4 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:09.637145 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4fc764c0-6c7e-4525-a554-f347fabf3ca4 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:09.637564 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-4fc764c0-6c7e-4525-a554-f347fabf3ca4 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:09.770391 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-4fc764c0-6c7e-4525-a554-f347fabf3ca4 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:06:09.778310 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-4fc764c0-6c7e-4525-a554-f347fabf3ca4 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69" status: 200 len: 1319 microversion: 2.1 time: 0.157237 Jun 20 15:06:09.778878 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 526/1032] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:06:09 2022] GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:06:10.799573 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-eef8865e-e91a-41a1-8435-f7180d6dccbb tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:10.800551 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-eef8865e-e91a-41a1-8435-f7180d6dccbb tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:10.808247 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eef8865e-e91a-41a1-8435-f7180d6dccbb tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:10.808688 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eef8865e-e91a-41a1-8435-f7180d6dccbb tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:10.809484 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eef8865e-e91a-41a1-8435-f7180d6dccbb tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:10.809910 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-eef8865e-e91a-41a1-8435-f7180d6dccbb tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:10.945346 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-eef8865e-e91a-41a1-8435-f7180d6dccbb tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:06:10.952783 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-eef8865e-e91a-41a1-8435-f7180d6dccbb tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69" status: 200 len: 1319 microversion: 2.1 time: 0.159736 Jun 20 15:06:10.953385 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 507/1033] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:06:10 2022] GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:06:11.974386 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-63ff181b-25cc-41a8-932a-4e2fb587afc1 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:11.975326 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-63ff181b-25cc-41a8-932a-4e2fb587afc1 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:11.986118 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-63ff181b-25cc-41a8-932a-4e2fb587afc1 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:11.986851 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-63ff181b-25cc-41a8-932a-4e2fb587afc1 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:11.988102 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-63ff181b-25cc-41a8-932a-4e2fb587afc1 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:11.988801 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-63ff181b-25cc-41a8-932a-4e2fb587afc1 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:12.130010 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-63ff181b-25cc-41a8-932a-4e2fb587afc1 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:06:12.137758 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-63ff181b-25cc-41a8-932a-4e2fb587afc1 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69" status: 200 len: 1319 microversion: 2.1 time: 0.170414 Jun 20 15:06:12.138320 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 527/1034] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:06:11 2022] GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:06:12.583650 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-2a58c1d6-664c-4089-bd07-6e36340c2514 req-95834afc-cabb-408a-8147-2cfba921036a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df1ce8f7-7ca4-4277-af4c-4884f6aa8c69", "name": "network-vif-plugged", "status": "completed", "tag": "ec8e2a94-131d-4419-b6e2-7aaf73cd99e3"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:06:12.593919 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-2a58c1d6-664c-4089-bd07-6e36340c2514 req-95834afc-cabb-408a-8147-2cfba921036a service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:12.594378 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-2a58c1d6-664c-4089-bd07-6e36340c2514 req-95834afc-cabb-408a-8147-2cfba921036a service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:12.606337 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-2a58c1d6-664c-4089-bd07-6e36340c2514 req-95834afc-cabb-408a-8147-2cfba921036a service nova] Creating event network-vif-plugged:ec8e2a94-131d-4419-b6e2-7aaf73cd99e3 for instance df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 on hv-cinder-83697 Jun 20 15:06:12.611376 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-2a58c1d6-664c-4089-bd07-6e36340c2514 req-95834afc-cabb-408a-8147-2cfba921036a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031644 Jun 20 15:06:12.611943 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 508/1035] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:06:13.159014 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-14a69d35-3d32-494b-80b0-0f2211deffd3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:13.159875 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-14a69d35-3d32-494b-80b0-0f2211deffd3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:13.167722 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-14a69d35-3d32-494b-80b0-0f2211deffd3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:13.168159 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-14a69d35-3d32-494b-80b0-0f2211deffd3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:13.168957 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-14a69d35-3d32-494b-80b0-0f2211deffd3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:13.169378 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-14a69d35-3d32-494b-80b0-0f2211deffd3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:13.310712 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-14a69d35-3d32-494b-80b0-0f2211deffd3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:06:13.318545 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-14a69d35-3d32-494b-80b0-0f2211deffd3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69" status: 200 len: 1319 microversion: 2.1 time: 0.166133 Jun 20 15:06:13.319112 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 528/1036] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:06:13 2022] GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:06:14.334343 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell0:SELECT=2 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:06:14.339042 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-2e6e7563-ec98-4a05-aa47-e8a8d192697a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:14.339803 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-2e6e7563-ec98-4a05-aa47-e8a8d192697a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:14.346850 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2e6e7563-ec98-4a05-aa47-e8a8d192697a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:14.347310 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2e6e7563-ec98-4a05-aa47-e8a8d192697a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:14.348093 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2e6e7563-ec98-4a05-aa47-e8a8d192697a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:14.348541 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-2e6e7563-ec98-4a05-aa47-e8a8d192697a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:14.480184 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-2e6e7563-ec98-4a05-aa47-e8a8d192697a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:06:14.488498 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-2e6e7563-ec98-4a05-aa47-e8a8d192697a tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69" status: 200 len: 1508 microversion: 2.1 time: 0.155885 Jun 20 15:06:14.489109 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 509/1037] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:06:14 2022] GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:06:14.505835 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-7a0c975b-e1c5-4ca1-80bf-744607e2857c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccb3e933-cd5f-456a-8ff9-c681433363af", "device": "/dev/sdb"}} {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:06:14.507413 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-7a0c975b-e1c5-4ca1-80bf-744607e2857c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:14.510088 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:06:14.510906 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell0:SELECT=6 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:06:14.517180 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7a0c975b-e1c5-4ca1-80bf-744607e2857c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:14.517626 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7a0c975b-e1c5-4ca1-80bf-744607e2857c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:14.518401 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7a0c975b-e1c5-4ca1-80bf-744607e2857c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:14.518830 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-7a0c975b-e1c5-4ca1-80bf-744607e2857c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:14.778928 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-7a0c975b-e1c5-4ca1-80bf-744607e2857c tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "POST /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276931 Jun 20 15:06:14.779758 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 529/1038] 10.222.0.23 () {60 vars in 1322 bytes} [Mon Jun 20 15:06:14 2022] POST /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:06:31.085190 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-08289bb1-0eb2-42cc-9f15-0f533f23583e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:31.085681 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-08289bb1-0eb2-42cc-9f15-0f533f23583e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:31.087637 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:06:31.088331 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG dbcounter [-] [123978] Writing DB stats nova_cell1:SELECT=26 {{(pid=123978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:06:31.094230 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-08289bb1-0eb2-42cc-9f15-0f533f23583e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:31.094666 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-08289bb1-0eb2-42cc-9f15-0f533f23583e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:31.095419 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-08289bb1-0eb2-42cc-9f15-0f533f23583e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:31.095844 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-08289bb1-0eb2-42cc-9f15-0f533f23583e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:31.180914 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.objects.instance [None req-08289bb1-0eb2-42cc-9f15-0f533f23583e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lazy-loading 'services' on Instance uuid df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 {{(pid=123978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 15:06:31.260426 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-08289bb1-0eb2-42cc-9f15-0f533f23583e tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69/os-volume_attachments/ccb3e933-cd5f-456a-8ff9-c681433363af" status: 202 len: 0 microversion: 2.1 time: 0.179355 Jun 20 15:06:31.261510 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 510/1039] 10.222.0.23 () {58 vars in 1415 bytes} [Mon Jun 20 15:06:31 2022] DELETE /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69/os-volume_attachments/ccb3e933-cd5f-456a-8ff9-c681433363af => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 15:06:32.387736 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:06:32.388755 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG dbcounter [-] [123979] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=123979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:06:32.394612 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-16a4fd97-c4df-4e10-9639-12039bfc7677 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:32.395200 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-16a4fd97-c4df-4e10-9639-12039bfc7677 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:32.403580 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-16a4fd97-c4df-4e10-9639-12039bfc7677 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:32.404027 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-16a4fd97-c4df-4e10-9639-12039bfc7677 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:32.404851 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-16a4fd97-c4df-4e10-9639-12039bfc7677 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:32.405273 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-16a4fd97-c4df-4e10-9639-12039bfc7677 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:32.583496 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-16a4fd97-c4df-4e10-9639-12039bfc7677 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Going to try to terminate instance {{(pid=123979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 15:06:32.673263 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-16a4fd97-c4df-4e10-9639-12039bfc7677 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69" status: 204 len: 0 microversion: 2.1 time: 0.287682 Jun 20 15:06:32.673867 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 530/1040] 10.222.0.23 () {58 vars in 1238 bytes} [Mon Jun 20 15:06:32 2022] DELETE /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 15:06:32.683388 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-f26b2a53-da44-4836-9ca8-2d42050c50ab tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:32.684060 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-f26b2a53-da44-4836-9ca8-2d42050c50ab tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:32.691289 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f26b2a53-da44-4836-9ca8-2d42050c50ab tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:32.691728 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f26b2a53-da44-4836-9ca8-2d42050c50ab tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:32.692480 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f26b2a53-da44-4836-9ca8-2d42050c50ab tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:32.693062 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-f26b2a53-da44-4836-9ca8-2d42050c50ab tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:32.841589 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.policy [None req-f26b2a53-da44-4836-9ca8-2d42050c50ab tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:06:32.849642 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-f26b2a53-da44-4836-9ca8-2d42050c50ab tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69" status: 200 len: 1514 microversion: 2.1 time: 0.170767 Jun 20 15:06:32.850208 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 511/1041] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:06:32 2022] GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:06:33.872605 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-55c744fd-6daa-4930-808f-d3655850d0a3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:33.873784 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-55c744fd-6daa-4930-808f-d3655850d0a3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:33.884655 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-55c744fd-6daa-4930-808f-d3655850d0a3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:33.885441 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-55c744fd-6daa-4930-808f-d3655850d0a3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:33.886732 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-55c744fd-6daa-4930-808f-d3655850d0a3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:33.887443 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-55c744fd-6daa-4930-808f-d3655850d0a3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:34.026756 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-55c744fd-6daa-4930-808f-d3655850d0a3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:06:34.034857 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-55c744fd-6daa-4930-808f-d3655850d0a3 tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69" status: 200 len: 1514 microversion: 2.1 time: 0.169014 Jun 20 15:06:34.035462 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 531/1042] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:06:33 2022] GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:06:34.668040 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [req-1e9db267-f1af-4834-b239-bf17f98e1041 req-3f0c05da-6848-4eea-8f64-eff4d2b51ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df1ce8f7-7ca4-4277-af4c-4884f6aa8c69", "name": "network-vif-deleted", "tag": "ec8e2a94-131d-4419-b6e2-7aaf73cd99e3"}]} {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 15:06:34.677704 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-1e9db267-f1af-4834-b239-bf17f98e1041 req-3f0c05da-6848-4eea-8f64-eff4d2b51ba8 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:34.678132 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [req-1e9db267-f1af-4834-b239-bf17f98e1041 req-3f0c05da-6848-4eea-8f64-eff4d2b51ba8 service nova] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:34.689949 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.compute.server_external_events [req-1e9db267-f1af-4834-b239-bf17f98e1041 req-3f0c05da-6848-4eea-8f64-eff4d2b51ba8 service nova] Creating event network-vif-deleted:ec8e2a94-131d-4419-b6e2-7aaf73cd99e3 for instance df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 on hv-cinder-83697 Jun 20 15:06:34.695585 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [req-1e9db267-f1af-4834-b239-bf17f98e1041 req-3f0c05da-6848-4eea-8f64-eff4d2b51ba8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031224 Jun 20 15:06:34.699231 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 512/1043] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Jun 20 15:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 15:06:35.053214 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.api.openstack.wsgi [None req-60438c46-b15e-4f51-badc-43593ddd80bc tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:35.053826 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.compute.api [None req-60438c46-b15e-4f51-badc-43593ddd80bc tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:35.061835 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-60438c46-b15e-4f51-badc-43593ddd80bc tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:35.062683 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-60438c46-b15e-4f51-badc-43593ddd80bc tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:35.063525 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-60438c46-b15e-4f51-badc-43593ddd80bc tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:35.063954 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-60438c46-b15e-4f51-badc-43593ddd80bc tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:35.098234 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-60438c46-b15e-4f51-badc-43593ddd80bc tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:35.098659 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG oslo_concurrency.lockutils [None req-60438c46-b15e-4f51-badc-43593ddd80bc tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:35.099098 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.objects.instance [None req-60438c46-b15e-4f51-badc-43593ddd80bc tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lazy-loading 'fault' on Instance uuid df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 {{(pid=123979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 15:06:35.142960 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: DEBUG nova.policy [None req-60438c46-b15e-4f51-badc-43593ddd80bc tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2365819f6b8d4c0e83db04d90e710969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655fee4df800492ca9507af988943721', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 15:06:35.150023 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO nova.api.openstack.requestlog [None req-60438c46-b15e-4f51-badc-43593ddd80bc tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69" status: 200 len: 1309 microversion: 2.1 time: 0.101991 Jun 20 15:06:35.150605 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: [pid: 123979|app: 0|req: 532/1044] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:06:35 2022] GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 15:06:36.174881 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c2378fa7-6695-4ecd-ba44-241c0da4f0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Calling method '>' {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 15:06:36.175841 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.compute.api [None req-c2378fa7-6695-4ecd-ba44-241c0da4f0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] [instance: df1ce8f7-7ca4-4277-af4c-4884f6aa8c69] Fetching instance by UUID {{(pid=123978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 15:06:36.183307 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c2378fa7-6695-4ecd-ba44-241c0da4f0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:36.183746 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c2378fa7-6695-4ecd-ba44-241c0da4f0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:36.184501 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c2378fa7-6695-4ecd-ba44-241c0da4f0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 15:06:36.184962 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG oslo_concurrency.lockutils [None req-c2378fa7-6695-4ecd-ba44-241c0da4f0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Lock "316254da-3fa1-408c-aacc-695744828597" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 15:06:36.199880 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.wsgi [None req-c2378fa7-6695-4ecd-ba44-241c0da4f0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] HTTP exception thrown: Instance df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 could not be found. Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c2378fa7-6695-4ecd-ba44-241c0da4f0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Request method failure captured: Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: request: GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 HTTP/1.1 Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept: application/json Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Accept-Encoding: identity Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Connection: close Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Length: 0 Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Content-Type: application/json Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Host: 10.222.0.23 Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Openstack-System-Scope: None Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: User-Agent: python-urllib3/1.26.9 Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Auth-Token: gAAAAABisIyg-vljzbmcKVpfVikrqsULepqRYeP5hWtW3YS8K9ph0aEtCymTYPcyYkf0QMblJcsoOuF4kA5VhI0gKtkhY35Czt7A_bBbEt3otC23_SNnfwSLPsMi9BfyT_Zcv1xcyvmZM-raqLWvdCCwMItIahtF251iacZpFpgcoKmWJ2f3w1c Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Id: None Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Domain-Name: None Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Identity-Status: Confirmed Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Is-Admin-Project: True Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Id: default Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Domain-Name: Default Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Id: 655fee4df800492ca9507af988943721 Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Project-Name: tempest-VolumesSnapshotTestJSON-537331159 Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Role: member,reader Jun 20 15:06:36.201736 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Roles: member,reader Jun 20 15:06:36.203494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_655fee4df800492ca9507af988943721"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/655fee4df800492ca9507af988943721"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/655fee4df800492ca9507af988943721"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/655fee4df800492ca9507af988943721"}]}] Jun 20 15:06:36.203494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant: tempest-VolumesSnapshotTestJSON-537331159 Jun 20 15:06:36.203494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Id: 655fee4df800492ca9507af988943721 Jun 20 15:06:36.203494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-537331159 Jun 20 15:06:36.203494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User: tempest-VolumesSnapshotTestJSON-537331159-project Jun 20 15:06:36.203494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Id: default Jun 20 15:06:36.203494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Domain-Name: Default Jun 20 15:06:36.203494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Id: 2365819f6b8d4c0e83db04d90e710969 Jun 20 15:06:36.203494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: X-User-Name: tempest-VolumesSnapshotTestJSON-537331159-project Jun 20 15:06:36.203494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: method: > Jun 20 15:06:36.203494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: exception: Instance df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 could not be found. Jun 20 15:06:36.203494 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: action_args: {'id': 'df1ce8f7-7ca4-4277-af4c-4884f6aa8c69'} Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: {{(pid=123978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 could not be found. Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 15:06:36.204508 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 could not be found. Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 could not be found. Jun 20 15:06:36.206290 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: ERROR nova.api.openstack.wsgi Jun 20 15:06:36.208129 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: DEBUG nova.api.openstack.wsgi [None req-c2378fa7-6695-4ecd-ba44-241c0da4f0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] Returning 404 to user: Instance df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 could not be found. {{(pid=123978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 15:06:36.208129 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO nova.api.openstack.requestlog [None req-c2378fa7-6695-4ecd-ba44-241c0da4f0ce tempest-VolumesSnapshotTestJSON-537331159 tempest-VolumesSnapshotTestJSON-537331159-project] 10.222.0.23 "GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69" status: 404 len: 111 microversion: 2.1 time: 0.037233 Jun 20 15:06:36.208129 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: [pid: 123978|app: 0|req: 513/1045] 10.222.0.23 () {58 vars in 1235 bytes} [Mon Jun 20 15:06:36 2022] GET /compute/v2.1/servers/df1ce8f7-7ca4-4277-af4c-4884f6aa8c69 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 15:07:12.080614 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 15:07:12.081878 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Mon Jun 20 15:07:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 15:08:59.215752 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 15:08:59.216512 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Mon Jun 20 15:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 15:09:00.332939 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 15:09:00.334175 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Mon Jun 20 15:09:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 15:09:09.237209 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 15:09:09.238299 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Mon Jun 20 15:09:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 15:09:16.072035 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 15:09:16.073117 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Mon Jun 20 15:09:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 15:09:27.473136 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 15:09:27.473700 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Mon Jun 20 15:09:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 15:10:32.094712 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 15:10:32.095972 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Mon Jun 20 15:10:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 15:12:19.226322 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 15:12:19.227064 dv-cinder-836973-5-iscsi devstack@n-api.service[123978]: Mon Jun 20 15:12:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 15:12:20.347872 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 15:12:20.348575 dv-cinder-836973-5-iscsi devstack@n-api.service[123979]: Mon Jun 20 15:12:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!